Skip to main content

Reinforcement Learning Intern

Students And University

Company Description

It started with a simple idea: what if surgery could be less invasive and recovery less painful? Nearly 30 years later, that question still fuels everything we do at Intuitive. As a global leader in robotic-assisted surgery and minimally invasive care, our technologies—like the da Vinci surgical system and Ion—have transformed how care is delivered for millions of patients worldwide.

We’re a team of engineers, clinicians, and innovators united by one purpose: to make surgery smarter, safer, and more human. Every day, our work helps care teams perform with greater precision and patients recover faster, improving outcomes around the world.

The problems we solve demand creativity, rigor, and collaboration. The work is challenging, but deeply meaningful—because every improvement we make has the potential to change a life.

If you’re ready to contribute to something bigger than yourself and help transform the future of healthcare, you’ll find your purpose here.

Job Description

Primary Function of Position

The Reinforcement Learning Intern will report to future forward research lead and contribute to the development and evaluation of reinforcement learning (RL) algorithms in support of supervised autonomy initiatives. The intern will identify, train, and test several RL algorithms using data collected from the Intuitive surgical robot systems. While the bulk of this work will take place on offline-collected data (i.e., not in real-time on the robot), a stretch goal would be to deploy an RL algorithm to control the robot in real-time.

Essential Job Duties

  • Collect tele-operated simulation and/or real data from the surgical robot while performing a realistic exercise (e.g., Fundamentals of Laparoscopic Surgery pick-and-place). This is referred to as trajectory data and is critical for RL training.
  • Train off-the-shelf reinforcement learning algorithms (e.g., policy gradient methods, actor-critic methods, etc.) on the trajectory data and benchmark their performance using established metrics.
  • Adapt reinforcement learning algorithms to the surgical domain and exercise of interest and identify techniques for improving performance relative to off-the-shelf RL models.
  • Recommend a suggested algorithm / experimental setup moving forward (beyond the internship) based on experimental results, and present findings to the broader team.
  • Deploy chosen RL algorithm either in simulation or on the dV5 to validate its performance in real-time (vs. purely offline evaluation).

Qualifications

Required Skills and Experience

University Hiring Program Eligibility Requirements:

  • University Enrollment: Must be currently enrolled in and returning to an accredited degree-seeking academic program after the internship.
  • Internship Work Period: Must be available to work full-time (approximately 40 hours per week) during a 10-12 week period starting May or June. Specific start dates are shared during the recruiting process.

Required Education and Training

  • Current enrollment in an Engineering (e.g., Biomedical, Electrical), Robotics, Computer Science, or related degree-seeking program at the Doctorate level.

Working Conditions

  • None.

Preferred Skills and Experience

Competitive applicants have one or more of these skills and a willingness to learn others.

  • Deep experience with a deep learning framework (e.g., PyTorch or JAX).
  • Strong familiarity with reinforcement learning algorithms (e.g., policy gradient methods, actor-critic methods).
  • Willingness to learn about robotics and the application of RL to surgical robotics.
  • Excel in communicating, both in written and verbal form, about motivation for running experiments, experimental findings, and the implications of the work.
  • Experience with video-based and multimodal data analysis and processing.

Additional Information

Due to the nature of our business and the role, please note that Intuitive and/or your customer(s) may require that you show current proof of vaccination against certain diseases including COVID-19.  Details can vary by role.

Intuitive is an Equal Opportunity Employer. We provide equal employment opportunities to all qualified applicants and employees, and prohibit discrimination and harassment of any type, without regard to race, sex, pregnancy, sexual orientation, gender identity, national origin, color, age, religion, protected veteran or disability status, genetic information or any other status protected under federal, state, or local applicable laws.

Mandatory Notices

U.S. Export Controls Disclaimer:  In accordance with the U.S. Export Administration Regulations (15 CFR §743.13(b)), some roles at Intuitive Surgical may be subject to U.S. export controls for prospective employees who are nationals from countries currently on embargo or sanctions status.

Certain information you provide as part of the application will be used for purposes of determining whether Intuitive Surgical will need to (i) obtain an export license from the U.S. Government on your behalf (note: the government’s licensing process can take 3 to 6+ months) or (ii) implement a Technology Control Plan (“TCP”) (note: typically adds 2 weeks to the hiring process).  

For any Intuitive role subject to export controls, final offers are contingent upon obtaining an approved export license and/or an executed TCP prior to the prospective employee’s start date, which may or may not be flexible, and within a timeframe that does not unreasonably impede the hiring need. If applicable, candidates will be notified and instructed on any requirements for these purposes. 

We will consider for employment qualified applicants with arrest and conviction records in accordance with fair chance laws.

Accommodation & Accessibility Notice:

Intuitive is committed to providing reasonable accommodations to qualified individuals with disabilities. If you require assistance or an accommodation during any part of the application or interview process, please contact People Services at [email protected].

We provide market-competitive compensation packages, inclusive of base pay (paid at an hourly rate), benefits, and a housing allowance. It would not be typical for someone to be hired at the top end of range for the role, as actual pay will be determined based on several factors, including relevant skills and experience for this internship, degree-seeking academic program (PhD, Master’s, Bachelor’s, etc), year in school, and location. The hourly rate is prorated against the intern program salaries listed and total program compensation will be based on internship duration.

Base Compensation Range Region 1: $73 USD - $82 USD
Base Compensation Range Region 2: $62 USD - $70 USD
Shift: Day
Workplace Type: Onsite - This job is fully onsite.

**Important Notice to Job Seekers: Beware of Recruitment Scams**

We have been made aware of fraudulent emails and job offers being sent to candidates by individuals posing as representatives or recruiters of our company. Please be advised that we would never extend an offer of employment to anyone who has not formally submitted an application through our official careers site and completed our formal interview process.

To protect yourself from potential scams, please ensure that any communication you receive regarding job opportunities at our company directs you to our careers site (https://careers.intuitive.com/en/) for application submission.

The Future is Intuitive

At Intuitive, we envision a future where care is more connected, customized, and intelligent—so the question won’t just be how long we live, but how well.

Team members in HR, Engineering, and Analytics standing together with blue background

Work at Intuitive

Our culture defines us.

Our culture is driven by passionate people who truly want to make a difference. Learn more about our unique environment and the characteristics of people who thrive at our company.

Learn about our culture

Benefits

Our benefits overview.

We believe in supporting happy and healthy teams. As a valued team member, your benefits extend far beyond your hourly pay or salary. Learn more about our benefits and perks.

Explore employee benefits
Financial Offerings

Financial offerings

We're here to support your short- and long-term goals.
Family Support

Family support

At Intuitive, we believe in the importance of family and seek to foster a family-friendly culture.
Healthcare Plans

Healthcare plans

Like the patients we serve, your health is also very important to us.
Growth & Development

Growth & development

Your personal and professional growth and development is important to you--and to us.
Generic 2

Not yet ready to apply?

When you join our Talent Community, we‘ll keep you informed about all things Intuitive, including new job openings, employee stories, and company news. You’ll see how every day we‘re proving what‘s possible—for our careers and for minimally invasive robotic surgery.

Join our Talent Community