Talent.com
Simulation and Test Engineer (Conversational AI) - AU Based
Simulation and Test Engineer (Conversational AI) - AU BasedAndromeda Robotics • South Melbourne, VIC, AU
Simulation and Test Engineer (Conversational AI) - AU Based

Simulation and Test Engineer (Conversational AI) - AU Based

Andromeda Robotics • South Melbourne, VIC, AU
30+ days ago
Job type
  • Quick Apply
Job description

The Bigger Picture

At Andromeda Robotics, we’re not just imagining the future of human-robot relationships; we’re building it. Abi is the first emotionally intelligent humanoid companion robot, designed to bring care, conversation, and joy to the people who need it most. Backed by tier-1 investors and with customers already deploying Abi across aged care and healthcare, we’re scaling fast, and we’re doing it with an engineering-first culture that’s obsessed with pushing the limits of what’s possible.

This is a rare moment to join : we’re post-technical validation, pre-ubiquity, and building out the team that will take Abi from early access to global scale.

Our Values

  • Empathy  - Kindness and compassion are at the heart of everything we do.
  • Play  -  Play sharpens focus. It keeps us curious, fast and obsessed with the craft.
  • Never Settle - A relentless ambition, bias toward action, and uncomfortable levels of curiosity.
  • Tenacity - Tenacious under pressure, we assume chaos and stay in motion to adapt and progress.
  • Unity - Different minds. Shared mission. No passengers.

The Role

We are looking for a creative and driven Simulation and Test Engineer to build Andromeda's testing infrastructure for our conversational AI systems and embodied character behaviours. Your immediate focus will be creating robust test systems for Abi's voice-to-voice chatbot, social awareness perception, and gesture motor control. As this infrastructure matures, you'll extend it into simulation environments for generating synthetic training data for character animation and gesture models.

The Team

You'll work at the intersection of our character software, robotics, perception, conversational AI, controls, and audio engineering teams. We bring deep expertise from autonomous vehicles and robotics, including simulation backgrounds. You'll collaborate with product owners and technical specialists to define requirements, integrate systems, and ensure quality across our AI / ML stack.

Requirements

Phase 1 : Build The Test Foundation

  • Define and stand up synthetic test environments for our AI / ML conversational stack
  • Conversational AI testing : voice-to-voice chat quality, response appropriateness, tool calling accuracy
  • Memory system testing : context retention, recall accuracy, conversation coherence
  • Audio modelling and testing : multi-speaker scenarios, room acoustics, voice activity detection
  • Perception system testing : social awareness (face detection, gaze tracking, person tracking)
  • Gesture appropriateness testing : Working with our Controls / ML team, create test infrastructure to validate that Abi's body gestures
  • CI / CD and automated regression testing for all AI / ML subsystems
  • Custodian of quality metrics : if they don't exist, work with stakeholders to elicit use cases, derive requirements, and establish measurable quality metrics
  • Requirements formalisation : you're skilled at gathering, documenting, and tracing requirements back to test cases
  • Phase 2 : Scale To ML Training Infrastructure

    Our approach to gesture generation requires high-fidelity synthetic interaction data at scale. You'll investigate and build the infrastructure to generate this data, working closely with our character software team to define requirements and validate approaches.

  • Extend test environments into training data generation pipelines
  • Investigate and stand up simulation tools (e.g. Unity, Unreal Engine, Isaac Sim) to support our machine learning pipeline with synthetic data and validation infrastructure
  • Build infrastructure for fine-tuning character animation models on simulated multi-actor scenarios
  • Enable ML-generated gesture development to augment hand-crafted animation workflows
  • Create virtual environments with diverse social interaction scenarios for training and evaluation
  • Success In This Role Looks Like

    Months 1-3, stabilise our conversational system with automated regression tests and measurable quality benchmarks. By month 6, deliver an integrated simulation environment enabling rapid testing and iteration across our AI / ML stack.

    You'll design tests that push our systems beyond their limits and find what's brittle. Through trade studies and make-vs-buy decisions, you'll establish the infrastructure, set up automatic regression tests, and trace test cases back to high-level requirements. You'll be the final guardian, verifying that our AI and machine learning systems work as intended before integration with Abi's physical platform. Your work will directly impact the speed and quality of our development, ensuring that every software build is robust, reliable, and safe.

    Key Responsibilities

  • Architect and Build : Design, develop, and maintain scalable test infrastructure for conversational AI, perception, and gesture control systems
  • Own Testing Pipeline : Develop a robust CI / CD pipeline for automated regression testing, enabling rapid iteration and guaranteeing quality before deployment
  • Develop Test Scenarios : Create diverse audio environments, multi-actor social scenarios, and edge cases to rigorously test Abi's conversational and social capabilities
  • Model with Fidelity : Implement accurate models of Abi's hardware stack (cameras, microphone array, upper body motion) as needed for test and simulation scenarios
  • Enable Future ML Training : Design test infrastructure with an eye towards evolution into a simulation platform for generating synthetic training data for character animation and gesture models
  • Integrate and Collaborate : Work closely with the robotics, AI, and software teams to seamlessly integrate their stacks into the test infrastructure and define testing requirements
  • Analyse and Improve : Develop metrics, tools, and dashboards to analyse test data, identify bugs, track performance, and provide actionable feedback to the engineering teams
  • Ideally You Have

  • Bachelor or Masters in Computer Science, Robotics, Engineering, or a related field
  • 5+ years of professional experience testing complex AI / ML systems (conversational AI, perception systems, or embodied AI)
  • Strong programming proficiency in Python (essential); C++ experience valuable
  • Hands-on experience with LLM testing, voice AI systems, or chatbot evaluation frameworks
  • Understanding of audio processing, speech recognition, and / or computer vision fundamentals
  • Experience with testing frameworks and CI / CD tools (pytest, Jenkins, GitHub Actions, etc.)
  • Familiarity with ML evaluation metrics and experimental design
  • A proactive, first-principles thinker who is excited by the prospect of owning a critical system at an early-stage startup
  • Bonus Points

  • Experience with simulation platforms (e.g. Unity, Unreal Engine, NVIDIA Isaac Sim, Gazebo) and physics engines
  • Experience with character animation systems, motion capture data, or gesture generation
  • Knowledge of reinforcement learning, imitation learning, or synthetic data generation for training ML models
  • Experience with 3D modelling tools and game engine content creation
  • Understanding of ROS2 for robotics integration
  • Knowledge of sensor modelling techniques for cameras and audio
  • Experience building and managing large-scale, cloud-based simulation infrastructure
  • PhD in a relevant field
  • Benefits

    The salary for this position may vary depending on factors such as job-related knowledge, skills, and experience. The total compensation package may also include additional benefits or components based on the specific role. Details will be provided if an employment offer is made.

    If you’re excited about this role but don’t meet every requirement, that’s okay—we encourage you to apply. At Andromeda Robotics, we celebrate diversity and are committed to creating an inclusive environment for all employees. Let’s build the future together.

    We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, colour, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

    Please note : At this time, we are generally not offering visa sponsorship for this role.

    Create a job alert for this search

    Test Engineer • South Melbourne, VIC, AU

    Similar jobs
    AI Engineer

    AI Engineer

    Aurecon • City of Melbourne, Victoria, Australia
    If you’re looking for a fresh challenge, why choose Aurecon? It comes down to one, crucial question : What kind of world do you want to create for the next generation? Truth is, the decisions being ...Show more
    Last updated: 30+ days ago • Promoted
    Autonomous Vessel Test Engineer (USV)

    Autonomous Vessel Test Engineer (USV)

    Leidos • City of Melbourne, Victoria, Australia
    A leading technology solutions provider is seeking a detail-oriented Product Test Engineer in Australia to ensure the functionality and certification of a 12m unmanned boat.Responsibilities include...Show more
    Last updated: 24 days ago • Promoted
    Senior AI Engineer

    Senior AI Engineer

    Salt Recruitment • City of Melbourne, Victoria, Australia
    We’re seeking a Senior AI Engineer to play a key role in leading the design, development, and delivery of cutting‑edge AI / ML solutions. This role combines hands‑on engineering with technical leade...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior AI Engineer : Scalable ML on AWS for SMB Docs

    Senior AI Engineer : Scalable ML on AWS for SMB Docs

    Myob Group Limited • City of Melbourne, Victoria, Australia
    A leading business management software provider in Melbourne is seeking a Machine Learning Engineer to join their Data & AI Team. You will develop and optimise machine learning systems tailored to s...Show more
    Last updated: 1 hour ago • Promoted • New!
    Lead Ai Engineer

    Lead Ai Engineer

    at • City of Melbourne, Victoria, Australia
    Lead AI Engineer - Melbourne, VIC.AI solutions across our client's organization.This senior leadership position involves setting technical direction, mentoring a high‑performing team, and deliverin...Show more
    Last updated: 1 hour ago • Promoted • New!
    Lead AI Engineer : Build Scalable AI Systems

    Lead AI Engineer : Build Scalable AI Systems

    Karbon • City of Melbourne, Victoria, Australia
    A leading practice management software company is seeking a Lead AI & ML Engineer based in Victoria, Australia.The successful candidate will have the opportunity to design, implement, and maintain ...Show more
    Last updated: 1 hour ago • Promoted • New!
    Artificial Intelligence Centre of Excellence| Full Stack Engineer | Senior Associate

    Artificial Intelligence Centre of Excellence| Full Stack Engineer | Senior Associate

    PricewaterhouseCoopers • City of Melbourne, Victoria, Australia
    The AI Center of Excellence is a team of highly experienced designers developers data scientists and analysts who are responsible for delivering digital products and AI solutions to PwCs business i...Show more
    Last updated: 1 hour ago • Promoted • New!
    Kafka Automation Test Engineer - 3-Month Contract

    Kafka Automation Test Engineer - 3-Month Contract

    Whizdom Recruitment • City of Melbourne, Victoria, Australia
    A leading recruitment consultancy is seeking an Application Tester for a 3-month engagement in Melbourne.The role involves designing and executing test strategies for Kafka-based data pipelines and...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Test & Evaluation (T&E) Engineer

    Senior Test & Evaluation (T&E) Engineer

    at • City of Melbourne, Victoria, Australia
    As back-to-back winners of the 2023 and 2024 Defence Innovator of the Year, DefendTex lives and breathes its values of integrity, innovation, professionalism, passion and risk taking.Our vision is ...Show more
    Last updated: 1 hour ago • Promoted • New!
    Product Test Engineer

    Product Test Engineer

    Leidos • City of Melbourne, Victoria, Australia
    Work on a leading Autonomous project.We’re a Family Friendly certified workplace we understand the diverse roles our team members need to play within their own unique family setting and actively su...Show more
    Last updated: 30+ days ago • Promoted
    Senior Ai Engineer — Llms, Aws & Scalable Ml

    Senior Ai Engineer — Llms, Aws & Scalable Ml

    Myob Group Limited • City of Melbourne, Victoria, Australia
    A leading business management software provider in Melbourne is seeking a Machine Learning Engineer to join their Data & AI Team. In this role, you will develop and optimise machine learning systems...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Machine Learning System Engineer

    Senior Machine Learning System Engineer

    Atlassian • City of Melbourne, Victoria, Australia
    Senior Machine Learning System Engineer at Atlassian.Join to apply for the Senior Machine Learning System Engineer role at Atlassian. Atlassians can choose where they work – whether in an office, fr...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior iOS Engineer - Education Platform (Remote AU)

    Senior iOS Engineer - Education Platform (Remote AU)

    Xplor • City of Melbourne, Victoria, Australia
    Remote
    A leading technology firm in Melbourne is seeking a Senior iOS Engineer to develop high-performance mobile applications for its Education platform. In this role, you'll be responsible for the full d...Show more
    Last updated: 30+ days ago • Promoted
    Test Analyst - Automation

    Test Analyst - Automation

    Red Energy • City of Melbourne, Victoria, Australia
    At Red Energy, we are passionate about providing award-winning customer service to over 1.Owned by Snowy Hydro, we are 100% Australian owned which our customers love us for.Our award winning team h...Show more
    Last updated: 15 days ago • Promoted
    Senior Platform Engineer - AWS, Kubernetes & AI

    Senior Platform Engineer - AWS, Kubernetes & AI

    Lendi • City of Melbourne, Victoria, Australia
    A leading digital mortgage platform is seeking a Senior Platform Engineer to join their Platform team in Melbourne, Australia. The role offers a collaborative environment focused on DevSecOps, manag...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Generative Gen AI Engineer (Sydney Based)

    Senior Generative Gen AI Engineer (Sydney Based)

    NCS Australia • City of Melbourne, Victoria, Australia
    Support for your move to Sydney no matter which state you’re coming from (Within Australia).As Gen AI Engineer at NCS Australia you’ll be instrumental in designing, developing and deploying machine...Show more
    Last updated: 1 hour ago • Promoted • New!
    Engineers AU Citizens

    Engineers AU Citizens

    Accenture • City of Melbourne, Victoria, Australia
    Participating in the Software Development Lifecycle (SDLC) to develop and enhance a C# based n-tier enterprise software and associated documentation. Developing automated application build and deplo...Show more
    Last updated: 1 hour ago • Promoted • New!
    AI Engineer

    AI Engineer

    Salt Recruitment • City of Melbourne, Victoria, Australia
    We’re seeking an experienced AI Engineer to join our Operations Technology team.In this role, you’ll design, build, and support AI / ML solutions that drive innovation and business performance acro...Show more
    Last updated: 28 days ago • Promoted