ECE516: Intelligent Image Processing

Schedule Labs Philosophy Opportunities 20-Year ECE516 History

Labs and authentic direct mentorship

Open your eyes to future possibilities:

(photos of metaveillance flux from EyeTap Instructable)

The most important part of this course is the labs which offer authentic direct mentorship with a high degree of involvement from the professor and other leading experts in imaging, sensing, meta-sensing, and human machine learning.

Our goal for the undergraduates is to help you get into grad school at MIT (Prof. Mann's alma mater) or Stanford, or to build the skills you need to found a great startup or be the world's leader in your chosen field, and for graduate students, finding a great thesis topic.

Lab topics (learn directly from the professor who invented many of these technologies and concepts):

  1. Fourier transform, wavelet transform, and chirplet transform;
  2. Machine learning for computer vision: Radar Vision and LEM neural network (world's first transform with machine learning built-in);
  3. AI for humans = Humanistic Intelligence (abbreviated H.I. or H. Int.)... link
  4. Wearable AI (Wearable AI = H. Int., link)
  5. VR (Virtual Reality), AR (Augmented Reality), XR (eXtended Reality), metaverse (metaverse.ieee.org), and beyond-metaverse = XV (eXtendiVerse).
  6. Biosignals and biosensing. In this lab we can build an ultrasound system to image the heart. [Analysis of Seismocardiographic Signals Using Polynomial Chirplet Transform...].
  7. Brain-Computer Interfaces (InteraXon company co-founded by Mann and his students));
  8. Fluid User Interfaces: Build a musical physiotherapy machine based on an array of ultrasonic lock-in amplifiers for phase-coherent sonar;
  9. See and photograph sound waves, radio waves, and light waves using your lock-in amplifier.
  10. Passive vision: Many courses on computer vision fail to teach the fundamental concepts of what sensing is and does. We'll begin with fundamental principles by exploring first a 1-pixel camera and 1-pixel display, quantigraphic (quantifiable) sensing, and meta-sensing.
  11. Understanding 3 phase motors and electric vehicles;
  12. Build your own autonomous e-vehicle...
  13. Complex-Valued Signal Generators
  14. Build a signal generator that produces a complex-valued output. You will fundamentally understand the difference between positive and negative frequencies and be able to explain that difference to a 5-year old child! In later labs you will use this signal generator as the foundation upon which to build autonomous electric vehicles!
  15. Phase-coherent detection for active computer vision:

Lab schedule 2024: Thursdays Jan 11, 25; Feb 8, 29; Mar 14 at 12noon

Note: Thurs Jan 18, 12noon, optional info session for Nuit Blanche, in BA3165, for those interested in participating. Here's some background info:
http://wearcam.org/ece516/nb/ 

Lab 1. What is a camera?
       .Pinhole camera (effect of aperture size),
       .Mathematical models tan(arctan())...,
       .Lens=optional part of lab.
        (easy to make from household items).
       .Intro to metaverse (free opensource Blender, Openbrush) and beyond...
       .Intro to Gitlab...

Lab 2. = Introduction to
XV (eXtended meta/uni/Verse = Physical Metaverse), XR (eXtended Reality),
XI (eXtended Intelligence), XB (eXtended Being, including Digital Twin),
XS (eXtended Society), IoTTT (Internet of Things that Think).



Labs 3, 4, and 5 will be updated based on student intestes this year.
See last year's labs (link).
Optional additional topics (depending on student interest):

Course instructor: Prof. Steve Mann

TAs: Ali and Navid