scholat open data-k8凯发旗舰

take your research further with scholat data
sroad (scholat research open-access dataset) is designed to help academics and independent researchers advance research objectives on academic social network, scholat knowledge graph, smart education and other ai related fields.

introduction

scholat is an emerging vertical social networking system designed and built specifically for scholars, learners and course instructors. the main goal of scholat is to enhance collaboration and social interactions focused around scholarly and learning discourses among the community of scholars. in addition to social networking capabilities, scholat incorporates various modules to encourage collaborative and interactive discussions, for example, chat, email, events, news posts, etc.

scholat open-access dataset

name nodes edges description
scholat social network 16,007 202,248 1st chinesecscw cup in 2020
scholat link prediction 10,755 train: 168,540
dev: 16,854
test: 16,854 		in 2021
anomaly detection on attributed network 2,022 2,500 view the details in our on tkde 2021
user-generated item recommendation 1,991 users 5,008 items view the details in our on kbs 2021
scholat interactive user recommendation 39,805 users 680,267 interactions in 2022
scholat multiplex network 2,302 co-friends: 11,393
co-team: 139,004
co-class: 70,226 		attributes: 477, communities: 11
in 2023

* more scholat open-access dataset will be released soon.

download notice

if you want to acquire any dataset, you should login to scholat and fill the application form.

k8凯发旗舰 copyright notice

  1. respect the privacy of personal information of the original source.
  2. the original k8凯发旗舰 copyright of all the dataset belongs to "scholat lab". "scholat lab" collects, organizes, filters and purifies them.
  3. if you want to use the dataset for depth study, data providers "scholat lab" should be identified in your results.
  4. the dataset is only for the specified applicant or study groups for research purposes. without permission, it may not be used for any commercial purposes.
  5. if the terms changed, the latest online version shall prevail.

1. scholat social network [download]

community is the implicit structure in social networks. in academic social networks, the users with similar or same research interests are more likely to be in the same community with close links and similar attributes. effective community detection results can be further utilized for user analytics and user recommendation.

this dataset aims to fuse user links and attributes for community detection. the dataset mainly consists of three parts where contains 16,007 users and 202,248 links. (1) "attribute" directory contains 16,007 files which are user attributes with the user ids as file names. (2) "links.txt" contains 202,248 lines and each line means that there exists one link (friendship, team members in the same research teams, or classmates in the same courses) between two users (represented as ids) which are split by tab. (3) "lexicons.txt" contains 25,817 words with 15,790 chinese words and 10,027 english words, which constitutes all the user attributes.

btw, the last version of this dataset has been successfully applied for the first chinesecscw big data analytics competition (1st chinesecscw cup) on the 15th chinese conference on computer supported cooperative work and social computing (chinesecscw 2020). view the details on https://www.scholat.com/confweb/ccscw2020/big_data_competiton.jsp. the difference between this version and the last version on chinesecscw cup is that we extend more user links.


how to cite:

  1. q. xu, l. qiu, r. lin, y. tang, c. he and c. yuan, "an improved community detection algorithm via fusing topology and attribute information," 2021 ieee 24th international conference on computer supported cooperative work in design (cscwd), 2021, pp. 1069-1074. [bibtex]

link prediction is an important research problem in academic social network analysis. it mines possible relationships among scholars by using existing network structure and external information. an effective link prediction method can support many personalized applications of academic social networks, including recommendation of scholars' friends/followers, completion/prediction of scholars' collaborative relationship, and recommendation of academic resources.

this dataset mainly contains the user attributes and links among 10,755 users from scholat. the "attribute" directory contains 10,755 files which are user attributes with the user ids as file names. "train.csv", "dev.csv" and "test.csv" are 168540, 16854 and 16854 undirected edges respectively with the 2-column user nodes.

this dataset will be used for the second chinesecscw big data analytics competition (2nd chinesecscw cup) on the 16th chinese conference on computer supported cooperative work and social computing (chinesecscw 2021).


how to cite:

  1. ronghua lin, yong tang, chengzhe yuan, chaobo he, weisheng li. scholat link prediction: a link prediction dataset fusing topology and attribute information. in: y. sun, t. lu, b. cao, h. fan, d. liu, b. du, l. gao (eds.), computer supported cooperative work and social computing, springer nature singapore, singapore, 2022, pp. 340–351.

3. anomaly detection on attributed network [download]

anomaly detection on attributed networks is an important task in social network analysis. the goal is to find the anomalies that deviate significantly from the majority of the network in terms of some proximities, e.g. topological structure or attribute proximity. an effective anomaly detection can support many applications such as web spam detection, system fraud detection, network intrusion detection and representation learning.

this dataset is adopted for simultaneously detecting structure/attribute-abnormal nodes and motif instances. the nodes represent the scholars and the edges denote the message interactions between the two ending nodes. the breadth first search with random restart is used to craw the nodes. and the nodes of degree no larger than 50 are preserved. the node attribute vectors are extracted by means of applying principal components analysis (pca) on the brief biographies of the corresponding scholars. after preprocessing and subset selection, the scholat dataset contains 2,022 nodes, 2,500 edges and 329 triangle motif instances. the dimension of the node attribute vectors is 500. the number of the motif-augmented edges is 8,361.


how to cite:

  1. l. huang, y. zhu, y. gao, t. liu, c. chang, c. liu, y. tang and c. wang, "hybrid-order anomaly detection on attributed networks," in ieee transactions on knowledge and data engineering, doi: 10.1109/tkde.2021.3117842. [bibtex]

4. user-generated item recommendation [download]

most of the existing recommendation methods assume that all the items are provided by separate producers, which is however not true in some recommendation tasks. that is, it is possible that some of the items are generated by users. appropriately considering the user-item generation relation may bring benefit to some recommender systems, e.g., implicit recommender systems with only implicit user-item interactions.

in our paper in knowledge-based systems 2022, we have proposed a new method called deep interaction-attribute-generation (diag) model, which integrates the user-item interaction relation, the user-item generation relation and the item attribute information into one deep learning framework. and we have collected two datasets, namely scholat and lizhi.

the scholat dataset is a post recommendation dataset obtained from the scholar social network k8凯发旗舰. the scholars are taken as users and the posts are taken as items. each post is generated by at most one scholar (i.e. user-item generation) and will be read by many scholars (i.e. user-item interaction). the item attribute vector is obtained by applying word2vec to the 0/1-valued word vector representing the absence/presence of each word in the title and content of the post. the dimension of the item attribute vector is 372. only the users with no less than 2 interactions are preserved. after preprocessing, a subset consisting of 1991 users and 5008 items is obtained. the number of user-item interactions is 13960. the number of user-item generations is 3776.

the lizhi dataset is an audio recommendation dataset obtained from the online audio platform . the normal users are taken as users and the audios are taken as items. each audio is generated by at most one user (i.e. user-item generation) and will be listened to by many users (i.e. user-item interaction). the item attribute vector characterizes the key information of the audio, namely the gender and age of the user generating this audio, and the bag of words (bow) representation of the tags of the audio. the dimension of the item attribute vectors is 514. only users with at least 10 user-item interactions are preserved. after preprocessing, a subset consisting of 3716 users and 9205 items is obtained. the number of user-item interactions is 858124. the number of user-item generations is 5744.

the source code and data are available at https://www.scholat.com/datasetapplication.html?dataset=diag_recommendation.


how to cite:

  1. ling huang, bi-yi chen, hai-yi ye, rong-hua lin, yong tang, min fu, jianyi huang, and chang-dong wang. diag: a deep interaction-attribute-generation model for user-generated item recommendation. knowledge-based systems 2022.

5. scholat interactive user recommendation [download]

interactive recommender systems (irs) have attracted more and more attention in recent years, which can receive user feedbacks on the recommendation list and constantly improve the recommendation results. this dataset contains 39,805 users and 680,267 historical interactions among them from scholat. the "user_attribute" directory contains 39,805 files which are user attributes with the user ids (from 0 to 39,804) as file names. the user attributes are extracted from their biography in scholat and most of them are in chinese. the file "user_interactions.txt" contains all the user interactions that are in the format as "user1::user2::reward::timestamp", where "user1" is the id of user1, "user2" is the id of user2, "reward" represents the feedback or rating on user2 by user1, and "timestamp" is the time at which this interaction happened. more specifically, if user1 clicks or browses user2's homepage, the reward is set as 1. if user1 follows user2, the reward is set as 3. if user1 unfollows user2, the reward is -1. all the user ids range between 0 and 39,804.

this dataset will also be used for the third chinesecscw big data analytics competition (3rd chinesecscw cup) on the 17th chinese conference on computer supported cooperative work and social computing (chinesecscw 2022).


how to cite:

  1. ronghua lin, feiyi tang, chaobo he, zhengyang wu, chengzhe yuan, and yong tang. dirs-kg: a kg-enhanced interactive recommender system based on deep reinforcement learning. world wide web journal (2023).

6. scholat multiplex network [download]

the scholat multiplex network provides a comprehensive list of social information. in this network, we construct a multiplex structure with three layers: (1) the first layer represents connections between users who become friends. (2) the second layer represents connections between users who join the same groups. (3) the third layer represents connections between users who study the same courses. furthermore, we define an individual ground-truth community based on the affiliation of users. all layers consist of the same 2,302 nodes with the highest quality. each layer has a specific number of edges: 11,393 for the first layer, 139,004 for the second layer, and 70,226 for the third layer. we have divided these nodes into 11 communities.

this dataset will also be used for the fourth chinesecscw big data analytics competition (4th chinesecscw cup) on the 18th chinese conference on computer supported cooperative work and social computing (chinesecscw 2023).


k8凯发旗舰 copyright ©2009-2024. k8凯发旗舰

网站地图