Calhacks 11.0 Michael Siu, Richard Peng, Yiling Yuan, Zhen Liu
Quizcribe is an educational software that supplements students with AI-powered study resources generated from inputted videos or audio. By entering a link to a video, such as one from YouTube, Quizcribe automatically transcribes the video, returns a detailed summary of its content, and generates an interactive quiz game for knowledge testing and review.
Through providing a more versatile, time-efficient, and fun study medium, Quizcribe aims to expand the effectiveness of free online education, further expanding the accessibility of educational resources to people of all backgrounds.
Main Features:
- Automated speech-to-text transcription that converts videos/audio of any length into text.
- AI-powered video summary and interactive quiz generation.
- Video detection and transcription support for 16 languages.
To install dependencies:
pip install -r requirements.txt
cd calhacksmryz
npm install
Run App and API Server:
npm run dev
cd backend
python manage.py runserver
The app should be at localhost:3000
- Frontend: Next.js/React, Tailwind CSS, Material UI
- Backend: Django/Python
- API: Deepgram (Speech to Text), Google Gemini 1.5, YouTube DL
- Users are prompted to input a link, which is passed to the YouTube DL and extracted into a video file URL.
- Deepgram AI's Speech-To-Text API is then used to convert the audio into transcripts.
- Deepgram AI's built-in language detection system allows for the transcription of videos/audio in 16 languages.
- Gemini API is used to automatically provide consistently structured summaries for the plain text transcripts.
- Using a chain of thought approach, problem sets are generated from the summarized content. The logic behind this feature involves step-by-step prompt engineering that ensures the generated questions are relevant, thought-provoking, and aligned with the key concepts in the summarized content.
- Corrent answer are determined by AI-powered logic reasoning.
Summary to video url provided
Quiz
Result