axelpadilla.me

home

blog

NeuroSense Art

Homepage for the NeuroSense Art (NART) Project

Documentation

Tasks

  • Especificaciones PCEspecificaciones PCNecesitamos instalar los siguientes programas. Algunos de ellos en Windows y otros dentro de Linux a través de WSL Windows 1. Epic Games Launcher (Necesario para instalar y lanzar Unreal Engine) 1. Unreal Engine 1. Windows Terminal 1. Visual Studio Code (Windows) 1. WSL 2 (Ubuntu) Linux (en WSL) 1. git (Linux) 1. wget (Linux) 1. python3 & pip3 (Linux) 1. Miniconda (Linux) 1. NVIDIA CUDA on WSL - Aug 7th
  • Decide between existing song database or website for validation - Aug 7th
  • Finish user forms - Aug 7th
  • Unreal Engine Linking - Aug 11th (EOW)
  • Experiment testing done - Aug 11th (EOW)
  • Initial users for experiments - Aug 11th (EOW)

Experiment

  • experiment-designExperiment designThe current experiment design follow these four main steps: 1. The online candidate screening & selection: 1. Initial questionary to determine eligibility 1. Candidate signs consent physical consent forms: 1. NeuroSense-Art Informed Consent Form 1. BCI Calibration and baseline measurement 1. Play *chosen songs* and measure the candidates response. We propose two different approaches for this step: 1. Current/planned approach 1. Possible variation
  • experiment-emotionsExperiment EmotionsWe are going to base the emotions we want to evoke on this diagram based on the activation level and wether the emotion is positive and negative. Draft The process we follow is, we pick one emotion, like "fear" and we pick it's direct opposite "calm" * [ ] Fear * [ ] Calm * [ ] Happiness * [ ] Sadness MOOD.png
  • mood-meter-websiteNART Mood Meter WebsiteThe objective with this website is to evaluate our songs dataset, so we can have some data to back it up if we end up using it in the experiments. The way we intend to do this is by asking to users to complete a survey. In this survey, users will: * Listen to 4 songs on random categories * It was initially one of each category, but that would make the test potentially predictable, so I feel like it's better to randomize the category too. * Rate each song in a plane, depending on what the use

Multimedia Experience

  • AI ApproachAI ApproachThe AI approach for generating the multimedia experience consists of using the output of the BCI and our classifier to generate images with AI and then generate a multimedia experience using those images: % TODO % Pasted image 20230722213930.png Generation Strategies Once we decide on the AI for image generation, there are two distinct approaches for going from a bunch of images to a complete experience: jit-image-generation In this generation strategy we generate the images "live", with an
  • Unity Approach - Unity Approach

Meeting notes

  • Meeting Notes 13-07-2023Meeting Notes 13-07-2023Developer tools * [ ] Develop a tool that allows to start the unity development of the VR experience * [ ] Explore possibilities with unity Project Architecture meeting * [x] Understand the possibility of switching the experiment design * [x] Understanding the questions we want to ask * [ ] Diagram and document both architectures INC Mty Stand * [ ] Plan some stuff for our INC Mty stand After the meeting notes This diagram was made to illustrate (in general) what a neural network looks l
  • Meeting Notes 18-07-2023Meeting notes 18-07-2023Previous meeting notes Questions for next meeting * [ ] Differences between calibration in experiment and in INC Mty * [ ] Limitations for causing emotions through different channels (like video instead of audio) * [ ] Experiment architecture change * [ ] Experiment initial conditions Multimedia experience changes We are discussing some fundamental changes to the project architecture. 1. Using Unity for the multimedia experience (instead of AI image generation) 1. Choosing songs and assign
  • Meeting Notes 20-07-2023Meeting notes 20-07-2023Previous Meeting Notes Agenda * [x] Differences between calibration in experiment and in INC Mty * [x] Limitations for causing emotions through different channels (like video instead of audio) * [x] Experiment architecture change - Does not apply * [x] Experiment initial conditions Emotiv / Unicorn Bueno familiarizarnos con el Emotiv, pero es mejor empezar a trabajar con el Unicorn ya que tiene algunas diferencias. Diferencias de calibración Normalmente si es necesario calibrar individual
  • Meeting Notes 25-07-2023Meeting notes 25-07-2023Previous Meeting Notes Topics discussed * AI options * jit-image-generation * aot-image-generation * Color simulation dev-tool * Unity Approach * Experiment Songs * Experiment Shapes Tasks * [ ] Speak to Andy and decide between AI or Unity Attendance * Nicole Arana * Angela * Axel Padilla Next Meeting Notes
  • Meeting Notes 27-07-2023Meeting Notes 27-07-2023Previous Meeting Notes BCI Testing * Platform to design the experiment * Black screen + text + music * We do this for 20s with 3ish secs between each time * Next session tomorrow @ 11 AM * Another session next week TBD Presentation Nadia and * Database * Divide the progress in * Experiment * Admin aspects * Design aspects * Experience * Approaches (AI or Unity) Budget * The BCI was more expensive than we anticipated: 3,151.72 USD * This will not set us back budget-wise *
  • Meeting Notes 28-07-2023Meeting Notes 28-07-2023Previous Meeting Notes Is the Unity Approach possible? * Short answer, no. * Long answer, no, but an Unreal Engine Approach is. * We basically need to be able to connect Unreal to the BCI output asap Tasks * 7th August week - Define between Unreal Engine Approach and AI Approach * Try to connect Unreal Engine to the Devtool * Meeting August 3rd @ 12:00-1:30 PM office Attendance * Nicole Arana * Axel Padilla * Andrés Santin * Ángela Aguilar Next Meeting Notes
  • Writing Lab Meeting Notes 28-07-2023Writing Lab Meeting Notes 28-07-2023Previous Meeting Notes What is Writing Lab? * Tenemos como objetivo "socializar" el resultado de nuestro proyecto y mostrar como fue una experiencia educativa enriquecedora * Escribir un artículo público * Conferencia Internacional indexada (Scopus) * Revistas científicas de alto impacto (Q1 y Q2) * Se asigna un mentor, investigador experimentado con afinidad temática, experiencia en publicación * Trabaja de manera periódica con nosotros * Guía y estructura para llegar a un artículo publi
  • Meeting Notes 01-08-2023Meeting Notes 01-08-2023Previous Meeting Notes * We talked about the writing lab meeting * Talked about the possible conferences * Talked about wether we need a mentor or not Tasks * Meeting with Luis Guillermo to sort all of this out * Meeting Thursday @ b4 3 PM? * Revision Meeting @ 3 PM Next Meeting Notes

External Documents

  • consentimiento-informadoConsentimiento InformadoEl consentimiento informado es el procedimiento mediante el cual se garantiza que el sujeto ha expresado voluntariamente su intención de participar en una investigación científica, después de haber comprendido la información que se ha dado acerca de los objetivos de la misma, los beneficios, las molestias, posibles riesgos, sus derechos y responsabilidades. Ejemplos * Consentimiento Informado NeuroSense-Art
  • Cuestionario InicialCuestionario InicialPruebas Iniciales NeuroSense-Art Te invitamos a formar parte de nuestro emocionante proyecto de investigación, NeuroSense-Art, donde exploraremos la simulación de la sinestesia a través de una experiencia multimedia en tiempo real, basada en la lectura de las ondas cerebrales. En este formulario, nos gustaría recopilar información sobre ti antes de que participes en nuestras pruebas. La información que proporciones nos ayudará a comprender mejor tus características individuales y a analizar l