Talent.com
Simulation and Test Engineer (Conversational AI)

Simulation and Test Engineer (Conversational AI)

apply.workable.com - ATSVictoria, Australia
2 days ago
Job description

About Us

Andromeda Robotics is an ambitious social robotics company with offices in Melbourne and San Francisco, dedicated to creating robots that seamlessly and intelligently interact with the human world. Our first robot, Abi, is a testament to this vision—a custom-built platform designed from the ground up to be a helpful aid and intuitive partner in aged care homes. We are a passionate, collaborative team of engineers who solve some of the most challenging problems in AI and robotics. To accelerate our development and ensure Abi's reliability, we are seeking a foundational member to build out our capabilities to train and test our robot in simulation.

Our Values

Deeply empathetic - Kindness and compassion are at the heart of everything we do.

Purposely playful - Play sharpens focus. It keeps us curious, fast and obsessed with the craft.

Relentlessly striving - With relentless ambition, an action bias and constant curiosity, we don’t settle.

Strong when it counts - Tenacious under pressure, we expect problems and stay in motion to adapt and progress.

United in action - Different minds. Shared mission. No passengers.

The Role

We are looking for a creative and driven Simulation and Test Engineer to build Andromeda's testing infrastructure for our conversational AI systems and embodied character behaviours. Your immediate focus will be creating robust test systems for Abi's voice-to-voice chatbot, social awareness perception, and gesture motor control. As this infrastructure matures, you'll extend it into simulation environments for generating synthetic training data for character animation and gesture models.

The Team

You’ll work at the intersection of our character software, robotics, perception, conversational AI, controls, and audio engineering teams. We bring deep expertise from autonomous vehicles and robotics, including simulation backgrounds. You’ll collaborate with product owners and technical specialists to define requirements, integrate systems, and ensure quality across our AI / ML stack.

Phase 1 : Build The Test Foundation

  • Define and stand up synthetic test environments for our AI / ML conversational stack
  • Conversational AI testing : voice-to-voice chat quality, response appropriateness, tool calling accuracy
  • Memory system testing : context retention, recall accuracy, conversation coherence
  • Audio modelling and testing : multi-speaker scenarios, room acoustics, voice activity detection
  • Perception system testing : social awareness (face detection, gaze tracking, person tracking)
  • Gesture appropriateness testing : Working with our Controls / ML team, create test infrastructure to validate that Abi's body gestures
  • CI / CD and automated regression testing for all AI / ML subsystems
  • Custodian of quality metrics : if they don’t exist, work with stakeholders to elicit use cases, derive requirements, and establish measurable quality metrics
  • Requirements formalisation : you're skilled at gathering, documenting, and tracing requirements back to test cases

Phase 2 : Scale To ML Training Infrastructure

Our approach to gesture generation requires high-fidelity synthetic interaction data at scale. You’ll investigate and build the infrastructure to generate this data, working closely with our character software team to define requirements and validate approaches.

  • Extend test environments into training data generation pipelines
  • Investigate and stand up simulation tools (e.g. Unity, Unreal Engine, Isaac Sim) to support our machine learning pipeline with synthetic data and validation infrastructure
  • Build infrastructure for fine-tuning character animation models on simulated multi-actor scenarios
  • Enable ML-generated gesture development to augment hand-crafted animation workflows
  • Create virtual environments with diverse social interaction scenarios for training and evaluation
  • Success In This Role Looks Like

    Months 1-3, stabilise our conversational system with automated regression tests and measurable quality benchmarks. By month 6, deliver an integrated simulation environment enabling rapid testing and iteration across our AI / ML stack.

    You’ll design tests that push our systems beyond their limits and find what’s brittle. Through trade studies and make-vs-buy decisions, you’ll establish the infrastructure, set up automatic regression tests, and trace test cases back to high-level requirements. You’ll be the final guardian, verifying that our AI and machine learning systems work as intended before integration with Abi’s physical platform. Your work will directly impact the speed and quality of our development, ensuring that every software build is robust, reliable, and safe.

    Key Responsibilities

  • Architect and Build : Design, develop, and maintain scalable test infrastructure for conversational AI, perception, and gesture control systems
  • Own Testing Pipeline : Develop a robust CI / CD pipeline for automated regression testing, enabling rapid iteration and guaranteeing quality before deployment
  • Develop Test Scenarios : Create diverse audio environments, multi-actor social scenarios, and edge cases to rigorously test Abi’s conversational and social capabilities
  • Model with Fidelity : Implement accurate models of Abi’s hardware stack (cameras, microphone array, upper body motion) as needed for test and simulation scenarios
  • Enable Future ML Training : Design test infrastructure with an eye towards evolution into a simulation platform for generating synthetic training data for character animation and gesture models
  • Integrate and Collaborate : Work closely with the robotics, AI, and software teams to seamlessly integrate their stacks into the test infrastructure and define testing requirements
  • Analyse and Improve : Develop metrics, tools, and dashboards to analyse test data, identify bugs, track performance, and provide actionable feedback to the engineering teams
  • Ideally You Have

  • Bachelor or Masters in Computer Science, Robotics, Engineering, or a related field
  • 5+ years of professional experience testing complex AI / ML systems (conversational AI, perception systems, or embodied AI)
  • Strong programming proficiency in Python (essential); C++ experience valuable
  • Hands‑on experience with LLM testing, voice AI systems, or chatbot evaluation frameworks
  • Understanding of audio processing, speech recognition, and / or computer vision fundamentals
  • Experience with testing frameworks and CI / CD tools (pytest, Jenkins, GitHub Actions, etc.)
  • Familiarity with ML evaluation metrics and experimental design
  • A proactive, first-principles thinker who is excited by the prospect of owning a critical system at an early-stage startup
  • Bonus Points

  • Experience with simulation platforms (e.g. Unity, Unreal Engine, NVIDIA Isaac Sim, Gazebo) and physics engines
  • Experience with character animation systems, motion capture data, or gesture generation
  • Knowledge of reinforcement learning, imitation learning, or synthetic data generation for training ML models
  • Experience with 3D modelling tools and game engine content creation
  • Understanding of ROS2 for robotics integration
  • Knowledge of sensor modelling techniques for cameras and audio
  • Experience building and managing large-scale, cloud-based simulation infrastructure
  • PhD in a relevant field
  • The salary for this position may vary depending on factors such as job-related knowledge, skills, and experience. The total compensation package may also include additional benefits or components based on the specific role. Details will be provided if an employment offer is made.

    If you’re excited about this role but don’t meet every requirement, that’s okay—we encourage you to apply. At Andromeda Robotics, we celebrate diversity and are committed to creating an inclusive environment for all employees. Let’s build the future together.

    We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, colour, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

    #J-18808-Ljbffr

    Create a job alert for this search

    Test Engineer • Victoria, Australia

    Related jobs
    • Promoted
    Simulation and Test Engineer (Autonomous Navigation)

    Simulation and Test Engineer (Autonomous Navigation)

    DromedaVictoria, Australia
    Andromeda Robotics is an ambitious social robotics company with offices in Melbourne and San Francisco, dedicated to creating robots that seamlessly and intelligently interact with the human world....Show moreLast updated: 22 days ago
    • Promoted
    Test Engineer

    Test Engineer

    Pyramid Global TechnologiesAustralia, Victoria, Australia
    As a Test Engineer your mission is to help design and deliver a modern banking platform and supporting suite of services that provide simple and secure ways for our customers to engage with the ban...Show moreLast updated: 30+ days ago
    • Promoted
    Looking For Work Near Me? - Deliver with Uber Eats

    Looking For Work Near Me? - Deliver with Uber Eats

    Uber eatsMaryborough (Vic.), AU
    Start Delivering with Uber Eats.Delivering with Uber Eats is an alternative to a part-time or full-time job and you can get your earnings weekly. Delivering with Uber Eats allows you to earn quick c...Show moreLast updated: 9 days ago
    • Promoted
    Data Entry Clerk Work From Home - Part Time Focus Group Panelists

    Data Entry Clerk Work From Home - Part Time Focus Group Panelists

    ApexFocusGroupRich Avon East, Victoria, Australia
    Remote
    Now accepting applicants for Focus Group studies.Earn up to $1550 per week part-time working from home.Must register to see if you qualify. No Customer Service Representative Agent experience needed...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Director, AI / ML / Advanced Analytics, Automation & Digital Agent CoE

    Senior Director, AI / ML / Advanced Analytics, Automation & Digital Agent CoE

    CSL - AustraliaVictoria, Australia
    The AI / ML Advanced Analytics, Automation & Digital Agent CoE Lead is responsible for shaping and executing the AI and automation strategy across R&D. This role integrates advanced analytics, machine...Show moreLast updated: 30+ days ago
    • Promoted
    Senior PKI Architect : 199275

    Senior PKI Architect : 199275

    HKA EnterprisesVictoria, Australia
    Posted : 10 / 24 / 2025 Industry : Engineering Job Number : 199275 Pay Rate : $77 / hour.NO Corp to Corp or 3rd party Recruiter submittals, please. W2 Contract with Full Time hours.Client Title : IT Architec...Show moreLast updated: 13 days ago
    • Promoted
    ETL / Data Migration Test Analyst – Long Term Project (x5 Roles) (Locations : VIC, TAS)

    ETL / Data Migration Test Analyst – Long Term Project (x5 Roles) (Locations : VIC, TAS)

    Advance Delivery ConsultingVictoria, Australia
    Write ETL test data scripts, based on E2E mapping artifacts.Execute data scripts and detailed analysis on the scripts.Create strategies and test cases for applications that use ETL components.Data ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Engineer - Power System Design

    Senior Engineer - Power System Design

    Australian Energy Market Operator (AEMO)Shire of Central Goldfields, Victoria, Australia
    Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.AEMO is Australia’s independent energy system and market operator and system planner.Its purpose is to...Show moreLast updated: 5 days ago
    • Promoted
    Deliver with Uber Eats - Sign Up and Start Earning

    Deliver with Uber Eats - Sign Up and Start Earning

    Uber eatsMaryborough (Vic.), AU
    Start Delivering with Uber Eats.Delivering with Uber Eats is an alternative to a part-time or full-time job and you can get your earnings weekly. Delivering with Uber Eats allows you to earn quick c...Show moreLast updated: 9 days ago
    • Promoted
    Associate Director, AI & Advanced Analytics

    Associate Director, AI & Advanced Analytics

    CSL - AustraliaVictoria, Australia
    CSL's R&D organization is accelerating innovation to deliver greater impact for patients.With a project-led structure and a focus on collaboration, we’re building a future-ready team that thrives i...Show moreLast updated: 10 days ago
    • Promoted
    Senior Gen AI Analyst

    Senior Gen AI Analyst

    Bunnings GroupVictoria, Australia
    Senior Gen AI Analyst page is loaded## Senior Gen AI Analystlocations : Support Office VICposted on : Posted Todaytime left to apply : End Date : December 7, 2025 (29 days left to apply)job requi...Show moreLast updated: 4 days ago
    • Promoted
    Sign Up as A Delivery Person - Earn With Uber Eats

    Sign Up as A Delivery Person - Earn With Uber Eats

    Uber eatsMaryborough (Vic.), AU
    Start Delivering with Uber Eats.Delivering with Uber Eats is an alternative to a part-time or full-time job and you can get your earnings weekly. Delivering with Uber Eats allows you to earn quick c...Show moreLast updated: 9 days ago
    Test Engineer L3

    Test Engineer L3

    WiproVIC, AU
    Wipro Limited (NYSE : WIT, BSE : 507685, NSE : WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transf...Show moreLast updated: 30+ days ago
    • Promoted
    Looking For Part-Time Work? - Deliver with Uber Eats

    Looking For Part-Time Work? - Deliver with Uber Eats

    Uber eatsMaryborough (Vic.), AU
    Start Delivering with Uber Eats.Delivering with Uber Eats is an alternative to a part-time or full-time job and you can get your earnings weekly. Delivering with Uber Eats allows you to earn quick c...Show moreLast updated: 9 days ago
    • Promoted
    Simulation and Test Engineer (Conversational AI)

    Simulation and Test Engineer (Conversational AI)

    DromedaVIC, Australia
    Andromeda Robotics is an ambitious social robotics company with offices in Melbourne and San Francisco, dedicated to creating robots that seamlessly and intelligently interact with the human world....Show moreLast updated: 13 days ago
    • Promoted
    Senior Manager, AI & Advanced Analytics

    Senior Manager, AI & Advanced Analytics

    CSL - AustraliaVictoria, Australia
    CSL's R&D organization is accelerating innovation to deliver greater impact for patients.With a project‑led structure and a focus on collaboration, we’re building a future‑ready team that thrives i...Show moreLast updated: 10 days ago
    • Promoted
    Automation Test Lead

    Automation Test Lead

    Pyramid Global TechnologiesAustralia, Victoria, Australia
    Must have experience to work on any Selenium Java based framework for 4 / 5 Years.Sound have knowledge on Java Programming and Object Oriented Programming concept with some hand on experience prefera...Show moreLast updated: 30+ days ago
    • Promoted
    Director, AI & Advanced Analytics

    Director, AI & Advanced Analytics

    CSL - AustraliaVictoria, Australia
    Drives the implementation of AI / ML, advanced analytics, and automation solutions across R&D to improve scientific and operational outcomes. Supports strategy execution, capability development, and s...Show moreLast updated: 8 days ago