Building a Piano Roll App and Composing Music with Gemini 3.1 Pro | Alpha | PandaiTech

Building a Piano Roll App and Composing Music with Gemini 3.1 Pro

Build an interactive music interface and use AI to compose harmonious tracks through coding.

Learning Timeline
Key Insights

Advantage of Built-in Musical Knowledge

Gemini has 'inherent music composition knowledge' that allows it to produce harmonious compositions without dissonance compared to other AI models.

Hallucination Warning

Be cautious with image analysis; Gemini can experience 'hallucinations' where it provides incorrect answers about the presence of objects or people in a photo despite visual evidence.

Multimodal Strengths

Gemini is highly effective at processing various input formats simultaneously (text, image, video, and audio) to build complex applications in a short amount of time.
Prompts

Physics Simulation & Reflections

Target: Gemini
Develop this simulation featuring reflectivity, roughness, and other material properties. Ensure the spheres are actually reflected within each other.

Extract Receipt Data to Spreadsheet

Target: Gemini
Parse all these receipts and add them to a spreadsheet with these columns: date, item, total, and currency.

Build Earthquake Visualization from Video

Target: Gemini
Create an interactive earthquake visualization of Japan based on this video. First, list or show a map of Japan like this...
Step by Step

Building Apps and Composing Music with Gemini

  1. Open the Gemini 1.5 Pro interface (or the specified version 3.1 Pro).
  2. Enter an initial prompt to build a music app interface (like a piano roll) or a physics simulation.
  3. If the first result has bugs or missing functionality, provide specific feedback. Example: 'The spheres don't reflect in each other'.
  4. Use the 'Upload' button to upload reference files such as simulation videos or receipt images for data analysis.
  5. Click the 'Run' button to generate the app code based on the instructions and reference files.
  6. Test every interactive element in the generated app (such as the reflectivity slider, roughness, or music play button) to ensure the code is fully functional.
  7. For data tasks, instruct Gemini to organize information into a specific format like a table with columns: date, item, total, and currency.

More from AI-Powered Coding & App Development

View All