Machine Learning

Our Research

Our group develops theoretical models and practical technology for the processing of sensory data. We pursue and conduct projects on non-linear dictionary learning, large-scale unsupervised and semi-supervised learning, and inference and learning in neural circuits. Application domains of our learning and inference technology are acoustic data, visual data, and medical data.

We are part of the cluster of excellence Hearing4all and the Department of Medical Physics and Acoustics at the School of Medicine and Health Sciences.

The group was previously located at the TU Berlin and at the Goethe-University Frankfurt am Main. This website is currently under construction. For more details on our research please refer, for now, to our previous website at Frankfurt.

For any inquiries please contact Jörg Lücke.

Selected Recent Publications (Journals)

Sheikh, A.-S., Lücke, J. (2016).
Select-and-Sample for Spike-and-Slab Sparse Coding.
Advances in Neural Information Processing Systems (NIPS), 29: 3927-3935. (online accessbibtex)

Monk, T., Savin, C., and Lücke, J. (2016).
Neurons Equipped with Intrinsic Plasticity Learn Stimulus Intensity Statistics.
Advances in Neural Information Processing Systems (NIPS), 29: 4278-4286. (online accessbibtex)

J.A. Shelton, A.-S. Sheikh, J. Bornschein, P. Sterne, J. Lücke (2015).
Nonlinear Spike-and-slab Sparse Coding for Interpretable Image Encoding
PLoS One 10(5): e0124088 (online accessbibtex)

Z. Dai and J. Lücke (2014).
Autonomous Document Cleaning – A Generative Approach to Reconstruct Strongly Corrupted Scanned Texts.
IEEE Transactions on Pattern Analysis and Machine Intelligence 36(10): 1950-1962. (online access, bibtex)

A.-S. Sheikh, J. A. Shelton, J. Lücke (2014).
A Truncated EM Approach for Spike-and-Slab Sparse Coding.
Journal of Machine Learning Research, 15:2653-2687. (online access, bibtex)

M. Henniges, R. E. Turner, M. Sahani, J. Eggert, J. Lücke (2014).
Efficient Occlusive Components Analysis.
Journal of Machine Learning Research, 15:2689-2722. (online access, bibtex)

J. Bornschein, M. Henniges, J. Lücke (2013).
Are V1 simple cells optimized for visual occlusions? A comparative study.
PLOS Computational Biology 9(6): e1003062. (online access, bibtex)

C. Keck*, C. Savin*, J. Lücke (2012).
Feedforward Inhibition and Synaptic Scaling – Two Sides of the Same Coin?
PLOS Computational Biology 8(3): e1002432. (online access, bibtex)
*joint first authorship

J. Lücke and J. Eggert (2010). 
Expectation Truncation and the Benefits of Preselection in Training Generative Models.
Journal of Machine Learning Research 11:2855-2900. (pdfbibtexanimations)

Selected Recent Publications (Conferences)

Z. Dai, G. Exarchakis, and J. Lücke (2013).
What Are the Invariant Occlusive Components of Image Patches? A Probabilistic Generative Approach.
Advances in Neural Information Processing Systems 26, 243-251. (online access, bibtex)

J. A. Shelton, P. Sterne, J. Bornschein, A.-S. Sheikh,  and J. Lücke (2012).
Why MCA? Nonlinear sparse coding with spike-and-slab prior for neurally plausible image encoding.
Advances in Neural Information Processing Systems 25, 2285-2293. (online access, bibtex)

Z. Dai and J. Lücke (2012).
Autonomous Cleaning of Corrupted Scanned Documents - A Generative Modeling Approach. .
Proc. IEEE Computer Vision and Pattern Recognition (CVPR), 3338-3345.
(oral presentation and Google Student Travel Award). (pdf, bibtex)

Z. Dai and J. Lücke (2012).
Unsupervised Learning of Translation Invariant Occlusive Components.
Proc. IEEE Computer Vision and Pattern Recognition (CVPR), 2400-2407. (pdf, bibtex)

J. A. Shelton, J. Bornschein, A.-S. Sheikh, P. Berkes, and J. Lücke (2011).
Select and Sample – A Model of Efficient Neural Inference and Learning.
Advances in Neural Information Processing Systems 24, 2618-2626. (pdfbibtex).

G. Puertas*, J. Bornschein*, and J. Lücke (2010). 
The Maximal Causes of Natural Scenes are Edge Filters.
Advances in Neural Information Processing Systems 23, 1939-1947. (pdfbibtexsupplement, code)
 *joint first authorship

J. Lücke, R. Turner, M. Sahani, and M. Henniges (2009). 
Occlusive Components Analysis.
Advances in Neural Information Processing Systems 22, 1069-1077. (pdfbibtexsupplementary)

COPYRIGHT NOTICE

The papers listed above have been published after peer review in different journals or conference proceedings. These journals or proceedings remain the only definitive repository of the content. Copyright and all rights therein are usually retained by the respective publishers. These materials may not be copied or reposted without their explicit permission. Use for scholarly purposes only.

 

News

  • 12 Aug 2016
    Our paper "Select-and-Sample for Spike-and-Slab Sparse Coding." (Sheikh & Lücke) is accepted for the NIPS 2016 main conference.

  • 12 Aug 2016
    Our paper "Neurons Equipped with Intrinsic Plasticity Learn Stimulus Intensity Statistics." (Monk et al.) is accepted for the NIPS 2016 main conference.

  • 10-11 Aug 2016
    The international workshop "New Algorithms and Tools for Probabilistic Machine Learning" takes place at the Machine Learning Lab at Oldenburg University. Thanks to all developers and contributors!

  • 8-9 Aug 2016
    The international symposium "Advanced Machine Learning Methods for Pattern Recognition and Sensory Data Analysis" takes place in the NeSSy research building of Oldenburg University. Thanks to all speakers and participants!

  • 5 July 2016
    The paper "Speaker Tracking for Hearing Aids" (Thiemann et al.) is accepted for the IEEE International Workshop on Machine Learning for Signal Processing.

  • 2 June 2016
    Joanna Luberadzka has successfully defended her Master thesis in Hearing Technology and Audiology. Congratulations!

  • 16 May 2016
    Hamid Mousavi (MSc in Optimization) has joined the group as a PhD student.

  • 27 Feb 2016
    Our abstract by Savin et al. about optimal coding and intrinsic plasticity is presented at the COSYNE conference.

  • 9 Oct 2015
    A new research position for a doctoral student has become available.

  • 11 July 2015
    Our review paper "Beyond Manual Tuning of Hyperparameters" has been published by KI - Künstliche Intelligenz (see here).

  • 8 May 2015
    Our paper "Nonlinear Spike-and-slab Sparse Coding for Interpretable Image Encoding" (Shelton et al.) has been published by PLOS One (see here).

  • 7 Mar 2015
    The poster "A model of perceptual learning: from neuomodulation to improved performance." (Holca-Lamarre et al.) is presented at the COSYNE conference

  • 6 Mar 2015
    The poster "Maximal causes for a masking based model of STRFs in primary auditory cortex." (Sheikh et al.) is presented at the COSYNE conference

  • 1 Feb 2015
    Our project in the DFG priority program "Autonomous Learning" has started.

  • 1 Dec 2014
    Dr. Travis Monk has joined the group (formerly University of Otago).

  • 8 Oct 2014
    Our paper "A Truncated EM Approach for Spike-and-Slab Sparse Coding" has been published by the Journal of Machine Learning Research (see here).

  • 8 Oct 2014
    Our paper "Efficient Occlusive Components Analysis" has been published by the Journal of Machine Learning Research (see here).

  • 7 Oct 2014
    Local television broadcasts a report of our document cleaning approach (see here, in German only).

  • 1 October 2014
    The paper "Autonomous Document Cleaning – A Generative Approach to Reconstruct Strongly Corrupted Scanned Texts" (Dai & Lücke) is published by IEEE Transactions on Pattern Analysis and Machine Intelligence (see here).

  • 16 Sept 2014
    Maryam Sadreddini has joined the group (formerly Blekinge Institute of Technology).

  • 8 Sept 2014
    Georgios Exarchakis has joined the group (formerly Berkeley University).

  • 1 June 2014
    Abdul-Saboor Sheikh has joined the group (formerly TU Berlin).