Building a Piano Roll App and Composing Music with Gemini 3.1 Pro

Physics Simulation & Reflections

Extract Receipt Data to Spreadsheet

Build Earthquake Visualization from Video

Building Apps and Composing Music with Gemini

1. Open the Gemini 1.5 Pro interface (or the specified version 3.1 Pro).
2. Enter an initial prompt to build a music app interface (like a piano roll) or a physics simulation.
3. If the first result has bugs or missing functionality, provide specific feedback. Example: 'The spheres don't reflect in each other'.
4. Use the 'Upload' button to upload reference files such as simulation videos or receipt images for data analysis.
5. Click the 'Run' button to generate the app code based on the instructions and reference files.
6. Test every interactive element in the generated app (such as the reflectivity slider, roughness, or music play button) to ensure the code is fully functional.
7. For data tasks, instruct Gemini to organize information into a specific format like a table with columns: date, item, total, and currency.