The deadline is May 2nd at 10:00 Saarbrücken standard-time. You are free to hand in earlier. You will have to choose one topic from the list below, read the articles, and hand in a report that critically discusses this material and answers the assignment questions. Reports should summarise the key aspects, but more importantly, should include original and critical thought that show you have acquired a meta level understanding of the topic – plain summaries will not suffice. All sources you use should be appropriately referenced, any text you quote should be clearly identified as such. The expected length of a report is between 3 to 5 pages, but there is no limit.
For the topic of your assignment, choose one of the following:
Read [1], where the authors introduce a novel measure of correlation (or dependence) to detect associations in large data sets. The paper presents the findings in a very confident tone, but other researchers didn't entirely agree with [1]. Read [2] and [3] to see some of the rebuttals. The authors of [1] responded to [3] in [4] with the authors of [3] responding to [4] in [5].
Who is right here? Is [1] presenting false claims and over-selling the results? Are the authors of [3] purposefully mis-interpreting [1] and ignoring their claims? Are the authors of [2] presenting sensible criticism, or should the note be completely ignored? What is your opinion, is the concept of equitability a useful one, and is MIC a useful measure? Can data mining benefit from these? Consider also the latest pre-print [6] by the authors of [1] in your answer.
What does this exchange of letters and notes tell about the process of doing science? Has the general public been mis-led by some of these publications? Was the Science magazine wrong at publishing [1]? Should they retract it? Was it acceptable for PNAS to publish [3]? What is the value of pre-print servers such as arXiv (where [2] and [6] are published)?
Your report should answer to both the technical questions and the above questions about the process.
To answer to this assignment, you must have a good understanding of machine learning techniques in general, and deep learning techniques in special.
The most talked-about data analysis topic of the last years has definitely been deep learning. Many researchers have claimed that they have obtained impressive results with deep learning: they can classify images [7], write LaTeX articles that almost compile [8], dream up images [9], and even win against the best humans on GO [10].
Explain what is deep learning and how did the cited applications use various deep learning techniques. Do they all use one unified "deep learning algorithm"? If not, explain the differences and similarities between the approaches. Are they all really only about deep learning? For example, in your opinion, is AlphaGo primarily deep learning or reinforcement learning method? Did it do all feature selection automatically, or were there hand-crafted rules?
And have all these applications really been resounding success stories? Read also [11] and [12]. How do they affect on your opinion on deep learning? Does deep learning have anything to do with data mining and knowledge discovery? Is deep learning the best thing since sliced bread, just another bottle of snake oil, ill-defined term under which people place all kinds of research, or what?
Data Mining aims at finding interesting novel knowledge from data. Yet, what is interesting? What is interestingness? De Bie [13,14] argues interestingness is inherently subjective, and that we should try to model the state of mind of the analyst, and proposes to do so using information theoretic principles. Discuss. Example questions you could address, but are not limited to include: What are the desired properties of the functions \(InformationContent\) and \(DescriptionalComplexity\)? Is it not a play of words to hide subjective interestingness in two objective scores? Does it make sense to make the one subjective, and the other not? Can this be fixed? If so, how? How can we evaluate whether these functions behave well? That is, whether they correspond to what users find complex, resp. simple?
Cilibrasi and Vitanyi define the ultimate clustering using Kolmogorov complexity [15] and show it can be approximated using off-the-shelf compression algorithms: you only need to use a data compression algorithm that suits your data. Is the framework they propose as powerful as they claim? Does this make sense at all? Why and when (not)? Are there any hidden assumptions? Can you think of examples where this framework would not be so easy to apply, or not work at all?
Read [16]. What is the novelty of this paper w.r.t [15]? Are there key differences in the scores? What are the implications? How would you rate the novelty of this paper, what would you say is the key contribution?
(Bonus) In a follow-up paper [17] Cilibrasi and Vitanyi propose to use Google as a `compression algorithm'. Does this make sense? Argue why (not).
Return the assignment by email to tada-staff@mpi-inf.mpg.de by 2 May, 1000 hours. The subject of the email must start with [TADA]. The assignment must be returned as a PDF and it must contain your name, matriculation number, and e-mail address together with the exact topic of the assignment.
Grading will take into account both Hardness of questions, as well as whether you answer the Bonus questions.
You will need a username and password to access the papers outside the MPI network. Contact the lecturer if you don't know the username or password.