Recent/current topics:

• Representation

  • NLP

  • Vision

  • Multi-modal 

• Video understanding 

• Text-to-image generation

• Unsupervised learning, contrastive learning

• Meta-learning 

• Domain generalization

• DNN compression

• Information retrieval

• HPO/NAS

• ECG datasets

• Point-cloud

TODO topics:

• Text as a universal and generalizable representation of human tasks

• Representation properties in a high-dimensional vector space

• Information theory in deep learning

• Discovery of generalization in LM