Recruitment@QEDSoftware

1 month from now

Recruitment Challenge @ QED Software

This is an internal data mining challenge at QED Software, aiming at checking ML skills of new employees.

Overview

At QED Software, we use the KnowledgePit platform to challenge the data science community members to solve real business problems and test their skills, knowledge, and the most important - creative thinking. This challenge is not a competition but, first and foremost, a place for self-evaluation. If you have been invited to take part in it, you are likely a motivated data scientist. But what can you do with what we have prepared? Enter the challenge and check your skills!

What to know more about what is ahead of you? The task is to detect truly suspicious events and false alarms within network traffic alert data that the Security Operations Center (SOC) Team members have to analyse daily. An efficient classification model should help the SOC Team to optimise their operations significantly. Technical details are in the Task Description section.

We wish you good luck and satisfaction with your solution(s)!

This challenge is based on a data mining competition (Suspicious Network Event Recognition) organized in association with IEEE BigData 2019 conference. Check the original competition here.

Terms & Conditions

Challenge Participation Rules:

The Invitation e-mail you received contains your Schedule specifying your submission time limits and Organizer’s response times. Please check your deadlines and stick to them.

The challenge is organized by QED Software Sp. z o. o. (the Organizer) and is not open to the public.
Participants must be of legal age of majority (in Poland it is 18 years of age).
The challenge is open exclusively to individuals invited at the sole discretion of the Organizer.
Invitation to Challenge is sent by email and contains a Challenge schedule (timing and deadlines).
To take part in the Challenge, each Participant must register to the KnowledgePit platform (available at knowledgepit.ai or knowledgepit.ml).
A single individual may enroll in the challenge with only one KnowledgePit account.
The Participant is treated by the KnowledgePit platform as a Team of just 1 person (him/herself - so don’t be alarmed, you are yourself your own Team, and its Team Leader).
The Participant is expected to solve the task individually and submit his/her own solution through the Submissions tab on the Challenge site. The Participant may submit up to 10 solutions within the submission deadline. The last sent solution will be treated as the final solution.
Each Participant is obliged to provide the source code of the final solution and a short report (up to 2000 characters) describing this solution. The report must contain a brief overview of the used approach. The description should explain all data pre-processing steps and model construction steps. It should be submitted in the pdf format using the KnowledgePit submission tab by the deadline specified in the Invitation email.
The duration of the challenge is set by the Organizer and announced to each Participant in the invitation email sent to him/her. Each participant has no less than 2 weeks to submit their solutions and 1 week to submit the code and report (description). The Organizer will provide feedback to the Participant within 2 weeks from the report submission deadline (note that if you submit your work earlier than the deadline specified, it will not have any bearing on your results and will not obligate the Organiser to give you your feedback earlier than scheduled.).
Organizers hold the right to extend the deadlines for submitting solutions and/or reports. In such a case, they will inform participants about the change using email.
The Challenge is organized for the purpose of skill-testing and education. The participation is fully voluntary and the Organizer will not select any winners.
There is no prize in this Challenge.
Under no circumstances will the entry in this challenge, place in the ranking, or anything in these Rules be construed as an offer or contract of employment with the Organizer. You acknowledge that you have submitted your solutions voluntarily. You acknowledge that no confidential, fiduciary, agency, employment or other similar relationship is created between you and the Organizer by your acceptance of these Rules or your entry of your solution.
The Leaderboard is a table viewable in the Leaderboard tab of the Challenge website that shows the best solutions submitted in all editions of the challenge for the specified task, ranked according to their initial evaluation.
The final ranking of the Participants will be done based on the final evaluation results. In the case of draws in the evaluation scores, the time of the submission will be taken into account.
The Participant can see how his/her final solution is ranked vis-à-vis other solutions, and there is no prize, penalty, credit or other forms of valuation resulting from the position in the ranking.
Organizers are not responsible for any consequences of technical issues related to the participant’s ability to access the KnowledgePit platform or submit their solution, including without limitation for issues relating to internet connectivity. If due to internal technical problem with the KnowledgePit platform, the resulting delays or temporary unavailability of the platform it likely to impact the participant’s ability to timely submit his/her solution, the challenge deadline will be extended by the Organizer with the time of such unavailability and participants will be informed of such extension by email.
Each report, paper, and any other type of publication based on the participant’s research where data from this challenge is used should be consulted with QED Software Sp. z o.o. before publication in order to clear rights, references, and notices regarding both KnowledgePit, QED Software, and Security On-Demand as the institutions that provided data for the study.
Organizer may at its discretion reject any submission or disqualify any participant if the Organizer reasonably beliefs that it was – respectively - produced in an unfair or illegitimate way or submitted by a person who was cheating, using deception, or otherwise has broken the challenge rules without providing any additional explanation.
If you think you were excluded without reason, or have any questions, please contact the Organizer at contact@knowledgepit.ml.
By enrolling in this competition, the Participant grants his/her consent for the processing of her/his registration data and the submissions and reports, and grant the Organizer the rights to use such data and submissions for the purpose of evaluation.
Participant’s data is administered by QED Software sp. z o. o., and shall be processed in accordance with the European data protection and privacy rules (The General Data Protection Regulation (EU) 2016/679). For more information check Organizer’s Privacy Policy.

Enroll

Please log in to the system!

Task description

In this challenge, the task is to detect truly suspicious events and false alarms within the set of so-called network traffic alerts that the Security Operations Center (SOC) Team members have to analyze daily. An efficient classification model could help the SOC Team to optimize their operations significantly. This data set comes from IEEE BigData 2019 Cup: Suspicious Network Event Recognition challenge.

The data set available in the challenge consist of alerts investigated by a SOC team at the Security on Demand company (SoD). We call such signals 'investigated'. Each record is described by various statistics selected based on experts' knowledge and a hierarchy of associated IP addresses (anonymized), called assets. For each alert in the 'investigated alerts' data tables, there is a history of related log events (a detailed set of network operations acquired by SoD, anonymized to ensure the safety of SoD clients).

The data sets cover half a year between October 1, 2018, and March 31, 2019. You can find the description of columns from the 'investigated alerts' data in a separate file called column_descriptions.txt. We divided the main data into a training set and a test set based on alert timestamps. The training set (the file cybersecurity_training.csv) utilizes approximately four months, and the remaining part constitutes a test set (the file cybersecurity_test.csv). The format of those two files is the same - columns are separated by the vertical line '|' sign. However, the target column called 'notified' is missing in the test data.

The task and the format of submissions: the job is to predict which of the investigated alerts were considered truly suspicious by the SOC team and led to issuing a notification to SoD's clients. In the training data, this information is indicated by the column 'notified'. A submission should have a form of scores assigned to every record from the test data - each score in a separate line of a text file. You can find an example of a correctly formatted submission file in the Data files section.

Evaluation: we evaluate the quality of submissions using the AUC measure. The assessment is automatic. The preliminary results are published on the public leaderboard.

___________

You may find it useful to explore the publications linked to the original competition:

A. Janusz, D. Kałuza, A. Chadzynska-Krasowska, B. Konarsk, J. Holland, D. Slezak: IEEE BigData 2019 Cup: Suspicious Network Event Recognition. BigData 2019.

Q. H. Vu, D. Ruta, and L. Cen, “Gradient Boosting Decision Trees for Cyber Security Threats Detection Based on Network Events Logs,” in 2019 IEEE International Conference on Big Data, BigData 2019, Los Angeles, CA, USA, December 9-12, 2019, 2019.

C. Dongy, Y. Chen, Y. Zhang, B. Jiang, S. Liu, D. Han, and B. Liu, “An Approach For Scale Suspicious Network Events Detection,” in 2019 IEEE International Conference on Big Data, BigData 2019, Los Angeles, CA, USA, December 9-12, 2019, 2019.

T. Wang, C. Zhang, Z. Lu, D. Du, and Y. Han, “Identifying Truly Suspicious Events and False Alarms Based on Alert Graph,” in 2019 IEEE International Conference on Big Data, BigData 2019, Los Angeles, CA, USA, December 9-12, 2019, 2019.

Data files

In order to download competition files you need to be enrolled.

Leaderboard

Rank	Team Name	Score	Submission Date
1	mishka	0.9173	2022-08-11 01:25:15
2	QchallengED	0.9136	2021-11-1 11:33:05
3	haribo	0.9093	2022-03-19 12:01:49
4	neil	0.9032	2022-04-11 16:23:58
5	antag	0.9028	2021-11-11 14:55:26
6	lucy789	0.9027	2022-02-7 14:39:14
7	Work4QEDSoftware	0.9023	2021-10-24 16:12:43
8	ayyoletsgo	0.9015	2022-05-31 23:38:14
9	DeepTeam	0.8988	2022-05-18 17:36:52
10	random123	0.8987	2022-03-31 21:44:14
11	qualify123	0.8947	2022-03-18 10:26:51
12	startoni	0.8940	2021-06-20 23:32:37
13	jentetil	0.8849	2022-08-10 11:58:59
14	n3o2k7i8ch5	0.8833	2021-11-20 15:22:10
15	RD	0.8796	2022-01-29 11:46:36
16	PP	0.8763	2023-03-15 17:17:22
17	lol123	0.8719	2023-01-16 21:09:46
18	monicatraveler	0.8652	2022-08-10 00:53:33
19	Kolumbryna_23	0.8590	2021-05-20 22:49:51
20	cenic	0.8578	2021-06-20 14:17:59
21	BalboaXx	0.8569	2021-08-9 14:21:27
22	Llynd	0.8453	2022-04-12 22:06:41
23	Lipski	0.8197	2021-06-20 17:35:04
24	PeterM	0.7733	2022-08-8 20:29:06
25	QED_recruitment	0.7717	2021-12-12 22:53:41
26	Pierre	0.7696	2022-08-7 13:22:22
27	Rainbow	0.7591	2022-04-16 13:21:56
28	Vrael	0.7112	2021-07-7 22:11:31
29	Przemysław Potok	0.6899	2022-01-14 16:50:32
30	niekoniecznie	0.6829	2022-04-12 12:50:34
31	SuperLog	0.6418	2022-08-10 14:41:06
32	the_coffee_team	0.6093	2021-11-19 16:23:07
33	Mafii	0.5953	2021-11-7 23:25:34
34	Sam	0.5596	2021-07-7 22:24:31
35	-_-	0.5356	2022-10-17 14:48:43

Forum

This forum is for all users to discuss matters related to the competition. Good manners apply!

There is no topics in this competition.