Cognify: An On-Device, AI-powered Learning Assistant
Name
huang-siyong-meng-eecs-2025-thesis.pdf
Description
Thesis PDF
Size
1.65 MB
Format
Adobe PDF
Checksum (MD5)
fcbcc9271d02e0dc264e384dd714a325
Author(s)
Huang, Siyong
Advisor(s)
Han, Song
Date Issued
September 2025
Publisher
Massachusetts Institute of Technology
Abstract
Large Language Models (LLMs) have proven highly effective for a wide range of natural language processing tasks, but their size and compute requirements often restrict their use to powerful cloud-based infrastructures. In recent years, significant progress has been made in shrinking LLMs while maintaining performance levels comparable to much larger models. We are approaching the point where the capabilities of massive, multi-billion parameter models can be realistically replicated on consumer-grade devices. This thesis builds upon that foundation by developing an AI-powered note-taking application that runs entirely offline, using only the compute resources available on a personal laptop. The application is designed to listen to lectures alongside the student and provide support in real-time—through transcription, notes generation, and enabling context-aware search. Achieving this level of interactivity locally introduces challenges in reducing end-to-end latency, which this project addresses through both model-level optimizations and the design of efficient prompting and inference algorithms. A demo of the app can be found on Youtube.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
In Copyright - Educational Use Permitted
Copyright retained by author(s)
Persistent DSpace Link
