Meta is building the Metaverse, the "spatial internet" where immersive virtual worlds will coexist with the real world. Spatial AI team under Reality Labs (RL) develops cutting-edge technologies that serve as the foundation of Meta AR/VR products. From tracking & localization to context/semantic understanding, our team takes new technologies from early concept to the product level while prototyping and realizing the new experiences they open up. We are looking for software engineers who are passionate about building tracking & positioning solution for AR/VR devices. In this role, you will be involved in novel technology development using a variety of sensors for inertial and visual motion tracking, spatial mapping & understanding, and sensor fusion for positioning and places identification. You will collaborate with other engineers and researchers in deploying such solutions in RL devices and light-up the next generation experiences such as world-locked rendering, AI powered spatial recommendation, and fitness tracking.
Software Engineer, Sensor Fusion and Machine Learning Responsibilities:
- Lead the design and development of advanced tracking and sensor fusion algorithms that leverages visual/IMU inertial tracking with other sensor data (e.g., GPS, WiFi, magnetometer, barometer, etc.) to achieve robust and accurate device position estimation for AR/VR devices in any environments.
- Follow the state of art tracking & localization technology and define our tech roadmap for adopting these technologies into RL devices.
- Lead execution and collaboration with multidisciplinary engineering and research teams to drive technologies development from incubation to production.
- Be a go-to person to escalate the most complex online / production performance issues that require an in depth knowledge.
- Define projects for other engineers to possibly solve and achieve impact based on your direction.
Minimum Qualifications:
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
- Industry experience coding with C++ and Python for design and development of tracking, sensor fusion and machine learning technologies and systems.
- Experience in designing software systems and machine learning models targeted for edge devices.
- Demonstrated familiarity with modern machine learning algorithms and experience with modern machine learning frameworks such as PyTorch.
Preferred Qualifications:
- PhD degree in Computer Science, Computer Vision, Machine Learning, Robotics or related technical field.
- Experience in inertial/visual motion tracking, Kalman filters and state estimation, neural inertial fusion, visual or wireless positioning.
- Experience mobile optimization, DSP acceleration, Android Open Source Project.
- Experience in handling sensors such as IMU, magnetometer, WiFi/BLE, Camera and GNSS.
- Experience with common digital signal processing techniques such as digital filtering, Fourier transform, correlation, and modulation.
About Meta:
Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.
Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.
Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.
$85.10/hour to $251,000/year + bonus + equity + benefits
Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.