Machine Learning

Our Research

Our group develops theoretical models and practical technology for the processing of sensory data. We pursue and conduct projects on non-linear dictionary learning, large-scale unsupervised and semi-supervised learning, and inference and learning in neural circuits. Application domains of our learning and inference technology are acoustic data, visual data, and medical data.

We are part of the cluster of excellence Hearing4all and the Department of Medical Physics and Acoustics at the School of Medicine and Health Sciences.

The group was previously located at the TU Berlin and at the Goethe-University Frankfurt am Main. This website is currently under construction. For more details on our research please refer, for now, to our previous website at Frankfurt.

For any inquiries please contact Jörg Lücke.

Selected Recent Publications (Journals)

J.A. Shelton, A.-S. Sheikh, J. Bornschein, P. Sterne, J. Lücke (2015).
Nonlinear Spike-and-slab Sparse Coding for Interpretable Image Encoding
PLoS One 10(5): e0124088 (online accessbibtex)

Z. Dai and J. Lücke (2014).
Autonomous Document Cleaning – A Generative Approach to Reconstruct Strongly Corrupted Scanned Texts.
IEEE Transactions on Pattern Analysis and Machine Intelligence 36(10): 1950-1962. (online access, bibtex)

A.-S. Sheikh, J. A. Shelton, J. Lücke (2014).
A Truncated EM Approach for Spike-and-Slab Sparse Coding.
Journal of Machine Learning Research, 15:2653-2687. (online access, bibtex)

M. Henniges, R. E. Turner, M. Sahani, J. Eggert, J. Lücke (2014).
Efficient Occlusive Components Analysis.
Journal of Machine Learning Research, 15:2689-2722. (online access, bibtex)

C.-M. Svensson, S. Krusekopf, J. Lücke, M. T. Figge (2014).
Automated Detection of Circulating Tumour Cells With Naive Bayesian Classifiers.
Cytometry Part A 85(6): 501-511. (bibtex)

J. Bornschein, M. Henniges, J. Lücke (2013).
Are V1 simple cells optimized for visual occlusions? A comparative study.
PLOS Computational Biology 9(6): e1003062. (online access, bibtex)

C. Keck*, C. Savin*, J. Lücke (2012).
Feedforward Inhibition and Synaptic Scaling – Two Sides of the Same Coin?
PLOS Computational Biology 8(3): e1002432. (online access, bibtex)
*joint first authorship

J. Lücke and J. Eggert (2010). 
Expectation Truncation and the Benefits of Preselection in Training Generative Models.
Journal of Machine Learning Research 11:2855-2900. (pdfbibtexanimations)

J. Lücke (2009). 
Receptive Field Self-Organization in a Model of the Fine-Structure in V1 Cortical Columns.
Neural Computation, 21(10):2805-2845. (online accessbibtex)

J. Lücke and M. Sahani (2008). 
Maximal Causes for Non-linear Component Extraction.
Journal of Machine Learning Research 9:1227-1267. (pdfbibtex)

Selected Recent Publications (Conferences)

Z. Dai, G. Exarchakis, and J. Lücke (2013).
What Are the Invariant Occlusive Components of Image Patches? A Probabilistic Generative Approach.
Advances in Neural Information Processing Systems 26, 243-251. (online access, bibtex)

J. A. Shelton, P. Sterne, J. Bornschein, A.-S. Sheikh,  and J. Lücke (2012).
Why MCA? Nonlinear sparse coding with spike-and-slab prior for neurally plausible image encoding.
Advances in Neural Information Processing Systems 25, 2285-2293. (online access, bibtex)

Z. Dai and J. Lücke (2012).
Autonomous Cleaning of Corrupted Scanned Documents - A Generative Modeling Approach. .
Proc. IEEE Computer Vision and Pattern Recognition (CVPR), 3338-3345.
(oral presentation and Google Student Travel Award). (pdf, bibtex)

Z. Dai and J. Lücke (2012).
Unsupervised Learning of Translation Invariant Occlusive Components.
Proc. IEEE Computer Vision and Pattern Recognition (CVPR), 2400-2407. (pdf, bibtex)

J. A. Shelton, J. Bornschein, A.-S. Sheikh, P. Berkes, and J. Lücke (2011).
Select and Sample – A Model of Efficient Neural Inference and Learning.
Advances in Neural Information Processing Systems 24, 2618-2626. (pdfbibtex).

G. Puertas*, J. Bornschein*, and J. Lücke (2010). 
The Maximal Causes of Natural Scenes are Edge Filters.
Advances in Neural Information Processing Systems 23, 1939-1947. (pdfbibtexsupplement, code)
 *joint first authorship

J. Lücke, R. Turner, M. Sahani, and M. Henniges (2009). 
Occlusive Components Analysis.
Advances in Neural Information Processing Systems 22, 1069-1077. (pdfbibtexsupplementary)

COPYRIGHT NOTICE

The papers listed above have been published after peer review in different journals or conference proceedings. These journals or proceedings remain the only definitive repository of the content. Copyright and all rights therein are usually retained by the respective publishers. These materials may not be copied or reposted without their explicit permission. Use for scholarly purposes only.

 

News

  • 27 Feb 2016
    Our abstract by Savin et al. about optimal coding and intrinsic plasticity is presented at the COSYNE conference.

  • 9 Oct 2015
    A new research position for a doctoral student has become available.

  • 11 July 2015
    Our review paper "Beyond Manual Tuning of Hyperparameters" has been published by KI - Künstliche Intelligenz (see here).

  • 8 May 2015
    Our paper "Nonlinear Spike-and-slab Sparse Coding for Interpretable Image Encoding" (Shelton et al.) has been published by PLOS One (see here).

  • 7 Mar 2015
    The poster "A model of perceptual learning: from neuomodulation to improved performance." (Holca-Lamarre et al.) is presented at the COSYNE conference

  • 6 Mar 2015
    The poster "Maximal causes for a masking based model of STRFs in primary auditory cortex." (Sheikh et al.) is presented at the COSYNE conference

  • 1 Feb 2015
    Our project in the DFG priority program "Autonomous Learning" has started.

  • 1 Dec 2014
    Dr. Travis Monk has joined the group (formerly University of Otago).

  • 8 Oct 2014
    Our paper "A Truncated EM Approach for Spike-and-Slab Sparse Coding" has been published by the Journal of Machine Learning Research (see here).

  • 8 Oct 2014
    Our paper "Efficient Occlusive Components Analysis" has been published by the Journal of Machine Learning Research (see here).

  • 7 Oct 2014
    Local television broadcasts a report of our document cleaning approach (see here, in German only).

  • 1 October 2014
    The paper "Autonomous Document Cleaning – A Generative Approach to Reconstruct Strongly Corrupted Scanned Texts" (Dai & Lücke) is published by IEEE Transactions on Pattern Analysis and Machine Intelligence (see here).

  • 16 Sept 2014
    Maryam Sadreddini has joined the group (formerly Blekinge Institute of Technology).

  • 8 Sept 2014
    Georgios Exarchakis has joined the group (formerly Berkeley University).

  • 1 June
    Abdul-Saboor Sheikh has joined the group (formerly TU Berlin).

  • 25 April 2014
    We have openings for PhD positions and a postdoc position (see here).

  • 23 April 2014
    The paper "Efficient Occlusive Components Analysis" (Henniges et al.) is accepted by the Journal of Machine Learning Research

  • 15 April 2014
    The paper "A Truncated EM Approach for Spike-and-Slab Sparse Coding" (Sheikh et al.) is accepted by the Journal of Machine Learning Research

  • 26 March 2014
    The paper "Automated Detection of Circulating Tumour Cells With Naive Bayesian Classifiers" (Svensson et al.) is accepted by Cytometry Part A

  • 14 February 2014
    The paper "Autonomous Document Cleaning – A Generative Approach to Reconstruct Strongly Corrupted Scanned Texts" (Dai & Lücke) is accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence

  • 17 December 2013
    Jörg Bornschein (now CIFAR fellow at the University of Montreal) successfully defended his PhD Thesis at Frankfurt - Congratulations!

  • 12 November 2013
    Zhenwen Dai (now postdoc at the lab of Neil Lawrence, Sheffield, UK) successfully defended his PhD Thesis at Frankfurt - Congratulations!

  • 12 November 2013
    Christian Keck (now software engineer and consultant) successfully defended his PhD Thesis at Bochum - Congratulations!

  • 5 September 2013
    The paper "What Are the Invariant Occlusive Components of Image Patches? A Probabilistic Generative Approach" (Dai et al.) is accepted by the NIPS conference

  • 21 March 2013
    The paper "Are V1 simple cells optimized for visual occlusions? A comparative study" (Bornschein et al.) is accepted by PLOS Computational Biology

  • 10 January 2013
    Marc Henniges (now consultant for risk management) successfully defended his PhD Thesis at Frankfurt - Congratulations!