Software Engineer, Sensor Algorithms - Reality Labs - Meta

Reality Labs (RL) Sensors Team at Meta is helping build novel products in Augmented and Virtual Reality. Our team explores, develops, and delivers new cutting-edge sensing technologies that serve as the foundation of current and future AR/VR products at Meta. Sensors are a crucial component for enabling core features on our products such as world-locked rendering, hand, body & eye tracking, image stabilization, scene reconstruction, mapping, and health sensing.The team is composed of a multi-disciplinary team of engineers and scientists. We work cross-functionally across multiple products to deliver sensing solutions tailored for the requirements and constraints of each particular product/feature and develop platform technologies that can be reutilized across multiple products and product lines.We are looking for Software Engineers who are passionate about sensors and want to build performant and scalable software pipelines for sensor fusion and multi-modal machine learning algorithms for AR/VR. In this role you will work on implementation of software frameworks and tools for efficient ingestion of sensor data, scalable modal training and neural network architecture development, visualization of complex multi-modal sensor data, and more. You will collaborate with other engineers and researchers across Meta to develop new concepts and technologies for next generation sensor systems, including alternative sensing modalities and novel sensing algorithms.

RESPONSIBILITIES

Software Engineer, Sensor Algorithms - Reality Labs Responsibilities:

• Design and development of new frameworks and core software components to implement, optimize, visualize, and debug sensor fusion and machine learning algorithms.
• Design and prototype critical sensor technologies that combine multiple sensing modalities, while balancing system-level constraints on compute, performance, and power.
• Collaborate with other engineers and researchers across Meta to develop new concepts and technologies for next generation sensor systems, including alternative sensing modalities and novel sensing algorithms that advance the state-of-the-art in AR/VR systems.

MINIMUM QUALIFICATIONS

Minimum Qualifications:

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• 2+ years of experience coding with C++ and Python for design and development of sensor fusion and machine learning technologies and systems.
• Demonstrated experience with modern machine learning frameworks such as PyTorch or TensorFlow.
• Familiarity with modern machine learning algorithms, specifically in Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN), transformers, clustering, and dimensionality reduction.
• Experience with common digital signal processing techniques such as digital filtering, Fourier transform, correlation, and modulation.
• Experience in designing software systems and machine learning models targeted for edge devices.

PREFERRED QUALIFICATIONS

Preferred Qualifications:

• MS or PhD degree in Computer Science, Machine Learning, Robotics or related technical field.
• Familiarity with Simultaneous Localization and Mapping (SLAM) and Visual Inertial Odometry (VIO).
• Proven track record of achieving significant results as demonstrated by patents or first-authored publications.
• Familiarity with Inertial Sensors, Pressure Sensors, Magnetometers, and/or similar sensors.
• Familiarity with the emerging Augmented Reality and Virtual Reality technologies.
• Demonstrated experience collaborating cross functionally
• High levels of creativity and quick problem-solving skills.