Research Programmer Analyst - Machine Learning Department
Carnegie Mellon University
Location: Pittsburgh, Pennsylvania
Internal Number: 2016450
Carnegie Mellon University's mission is to build a transformative educational experience for students focused on deep disciplinary knowledge; problem solving; leadership, communication, and interpersonal skills; and personal health and well-being. Carnegie Mellon's School of Computer Science (SCS) is widely recognized as one of the first and the best computer science programs in the world. Our programs train the next generation of innovators to take real-world problems and improve the way people live and work.
Headquartered at Carnegie Mellon University, the Delphi research group was founded in 2012 to advance the theory and practice of epidemic forecasting. Pre-pandemic our focus was seasonal influenza; now it's COVID. Currently our focus is on developing and maintaining COVIDcast , which provides the nation's largest repository of diverse, geographically-detailed, real-time indicators of COVID activity. We work on the full data pipeline: several of the underlying data sources (on which these indicators are built) would not exist or be publicly available without our efforts; and on the other end, we use these indicators to power our nowcasting and forecasting models. COVIDcast is used regularly by public health officials, government agencies, data journalists, healthcare companies, financial firms, and fellow modelers. We work closely with the CDC, and are currently a CDC Center of Excellence for Forecasting (one of two nationally).
We are looking for a talented engineer to prevent, identify, diagnose, and rectify problems or outages that occur in the data processing pipelines for our indicators. This person will ideally have competency in linux systems administration, basic database & script programming, data analysis, and software engineering in a team setting. This is a combination of site reliability, operations, system administration, and light project management work. We currently run 12 individual indicator pipelines for tracking COVID, producing nearly 200 distinct time series. We're on schedule to exceed 2B data points over the summer, and plan to massively expand our coverage to include influenza in the coming months. Our job scheduling system was developed in-house, but for monitoring we use Elastic/Kibana and NewRelic. You do not need to have specific experience with either to apply.
Core responsibilities will include:
Maintain indicator uptime and correctness
Monitor system output
Identify the cause of any runtime errors, and either make repairs directly or recommend alternate solutions
Respond to bug reports from data users
Monitor our data sources for any changes in formatting or data collection policy, and either make the necessary adjustments to our code, or flag for review
Monitor system performance, and flag any trends that may jeopardize future uptime
Design, implement, and deploy changes or systems that will scale with dramatic (10x) increases to the data we process daily
Reduce maintenance effort
Improve fault response time
Decrease opportunities for human error
Flexibility, excellence, and passion are vital qualities within the School of Computer Science. Inclusion, collaboration and cultural sensitivity are valued competencies at CMU. Therefore, we are in search of a team member who is able to effectively interact with a varied population of internal and external partners at a high level of integrity. We are looking for someone who shares our values and who will support the mission of the university through their work.
Bachelor's Degree in Computer Science, Information Systems or related field required.
Minimum of 1 year of related experience required.
Basic linux system administration: system layout, file permissions, utilities (syslog, cron), diagnostic tools (ps, htop, grep)
Basic database use: mysql, mysqldump
Rough script programming (Python, bash)
Software development in a team setting (Python certainly; R if you have it)
Diagnosing and fixing runtime errors and logic bugs
Performing basic growth projections to predict future problems
Successful background check
COVID-19 Condition of Employment
As a condition of employment, Carnegie Mellon University requires all staff and faculty working in Pennsylvania, California, Washington D.C., New York and Virginia to be fully vaccinated against COVID-19. Prior to commencement of employment, new hires must provide proof of their vaccination or have an approved exemption.
New employees requesting a medical , religious or strong moral or ethical conviction exemption from the vaccine must complete and submit an exemption request form for review and approval. To receive the appropriate exemption request form, contact firstname.lastname@example.org . Employees with approved exemptions will be required to comply with all applicable COVID-19 mitigation requirements including use of facial coverings, Daily Self-Assessment and Weekly Tartan Testing.
Staff - Regular
Full Time/Part time
Please visit " Why Carnegie Mellon " to learn more about becoming part of an institution inspiring innovations that change the world.
Carnegie Mellon (www.cmu.edu) is a private, internationally ranked research university with programs in areas ranging from science, technology and business, to public policy, the humanities and the arts. More than 12,000 students in the university’s seven schools and colleges benefit from a small student-to-faculty ratio and an education characterized by its focus on creating and implementing solutions for real problems, interdisciplinary collaboration and innovation. A global university, Carnegie Mellon’s main campus in the United States is in Pittsburgh, Pa. It has campuses in California’s Silicon Valley and Qatar, and programs in Africa, Asia, Australia, Europe and Mexico.