Download - RecSys Challenge 2016
![Page 1: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/1.jpg)
RecSys Challenge 2016http://recsyschallenge.com - @recsyschallengeMartha, Róbert, András, Daniel, FabianRecSys, Boston, September 2016
![Page 2: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/2.jpg)
AgendaProceedings: titanpad.com/recsyschallenge2016
• 09:00-10:30 Welcome + Short presentations• 10:30-11:00 Coffee break• 11:00-12:30 Full Papers• 12:30-14:00 Lunch break• 14:00-15:30 Full Papers / Top 3• 15:30-16:00 Coffee break• 16:00-17:30 Panel Discussion: RecSys Challenge ‘17
2
![Page 3: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/3.jpg)
Job recommendations
![Page 4: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/4.jpg)
Job recommendations
![Page 5: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/5.jpg)
Example: item (job posting)5
![Page 6: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/6.jpg)
RecSys ChallengeGiven a user, the goal is to predict those job postings that the user will interact with.
6
Scala Dev (m/w)
?Scala Dev, Hamburg
job postings
Scala Engineer
2 months of impressions & interactions
click
bookmark
![Page 7: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/7.jpg)
Datasets1. Training data:
• User demographics (jobtitle, discipline, industry, career level, # CV entries, country, region) [1M]
• Job postings (title, discipline, industry, career level, country region) [1M]
• Interactions (user_id, item_id, interaction_type, timestamp) [10M, 2 months]
• Impressions (user_id, item_id, week) [30M, 2 months]2. Task files:
• Users (= User IDs for whom recommendations should be computed) [150k]
• Candidate items (= item IDs that are allowed to be recommended) [300k]
3. Solution (secret)• Interactions (user_id, item_id) [1M, 1 week]
Anonymization (Strings IDs; users and interactions are enriched with artitificial noise)
7
![Page 8: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/8.jpg)
Interaction Data includes interactions that were not performed on recommendations
8
![Page 9: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/9.jpg)
Evaluation MeasureMixture of… - Precision@k (k = 2, 4, 6,
20) = fraction of relevant items in the top k
- Recall@30 = fraction of relevant items in the top k
- Success@30 = probability that at least one relevant item was recommended in the top 30
9
![Page 10: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/10.jpg)
Who participated?• 119 teams participated (366 teams registered)
• Countries: - USA (25%)- Germany (11%)- China (9%)- France (7%)- Hungary (4%)
• Type of organization: - academia ( 25%)∼- industry ( 75%)∼
most common industry: Internet & IT larger companies such as Yandex, Alibaba, Microsoft or
Amazon as well as start-ups
10
![Page 11: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/11.jpg)
Top score over time
11
![Page 12: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/12.jpg)
Number of submissions per team
12
![Page 13: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/13.jpg)
Overlap with XING’s recommender
13
![Page 14: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/14.jpg)
Outlook for 2017• Current plan:
Domain: again job recommendations Additional perspectives:
- is the user a good candidate for the job?
- Novelty (recommending new jobs)
- New users (recommending jobs to new users)
Additional features (e.g. clicks from recruiters on profiles) Additional tooling:
- Proper API for submitting solutions
- Advanced Baseline implementations (building up on this year’s solutions)
• Goal: offline + online (!!) evaluation • More details: panel discussion in the afternoon
14
![Page 15: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/15.jpg)
Thank you to PC!• Alejandro Bellogín, Universidad Autónoma de Madrid, Spain• Paolo Cremonesi, Politecnico di Milano, Italy• Simon Dooms, Trackuity, Belgium• Balasz Hidasi, Gravity R&D, Hungary• Levente Kocsis, Hungarian Academy of Sciences, Hungary• Andreas Lommatzsch, TU Berlin, Germany• Katja Niemann, XING AG, Germany• Alan Said, University of Skövde, Sweden• Yue Shi, Yahoo Labs, USA• Marko Tkalcic, Free University of Bozen-Bolzano, Italy
15
![Page 16: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/16.jpg)
16
Thank you to RecSys
Challenge participants!
![Page 17: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/17.jpg)
Agenda• 09:00-10:30 Welcome + Short presentations• 10:30-11:00 Coffee break• 11:00-12:30 Full Papers• 12:30-14:00 Lunch break• 14:00-15:30 Full Papers / Top 3• 15:30-16:00 Coffee break• 16:00-17:30 Panel Discussion: RecSys Challenge ‘17
17
![Page 18: RecSys Challenge 2016](https://reader036.vdocuments.pub/reader036/viewer/2022062820/58aa33191a28abbb108b5da9/html5/thumbnails/18.jpg)
Thank you @recsyschallenge
http://recsyschallenge.com
www.xing.com