Director of Observability & Developer Excellence

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can proudly bring your authentic self to the workplace. Join us. You’ll do the best work of your career right here at Comcast. (In most cases, Comcast prefers to have employees on-site collaborating unless the team has been designated as virtual due to the nature of their work. If a position is listed with both office locations and virtual offerings, Comcast may be willing to consider candidates who live greater than 100 miles from the office for the remote option.)

Job Summary

Responsible for providing strategic leadership and executive oversight to all aspects of the Software Development and Engineering department's projects and activities. Develops and implements strategies and works with project personal to develop project standards and performance metrics. Works with Supervisors and Managers to ensure all applications meet project specifications and requirements. Provides leadership and direction for team which may include multiple functional areas. Develops and implements strategy for functional area(s). May have responsibility for developing and managing budget.

Job Description

Comcast’s Technology + Product (T+P) organization works at the intersection of media and technology. Our innovative teams are continually developing and delivering products that transform the customer experience.

About the Role:

We are seeking a Director of Observability to lead observability as a core pillar of our Developer Experience organization. This role focuses on empowering engineers with fast, actionable feedback about their systems—so they can build, debug, and operate software with confidence.

You’ll be part of team that dives observability strategy, platforms, and practices that enable developers to understand system behavior, detect issues early, and resolve problems independently. Will also be responsible for leveraging AI to make observability services much easier to use.  Success in this role means observability is intuitive, standardized, and seamlessly integrated into how developers design, ship, and run services.

Key Responsibilities:

DevEx Strategy & Leadership

• Define the observability vision aligned with developer productivity and cognitive load reduction.
• Lead and grow the team delivering developer‑first observability platforms and tooling.

Developer-Centered Observability

• Deliver low‑configuration, self‑service observability with clear standards for metrics, logs, traces, dashboards, and alerts.
• Ensure developers can quickly determine service health, changes, and root causes across all workflows.

Platform Architecture & Tooling

• Build scalable cloud/hybrid observability platforms with vendor‑neutral instrumentation (e.g., OpenTelemetry).
• Streamline and standardize tooling for usability, consistency, and cost efficiency.

Reliability Enablement

• Partner with SRE/Infra to strengthen reliability while enabling teams to own SLIs/SLOs.
• Improve incident detection, debugging speed, and learning through better telemetry and tooling.

Collaboration & Influence

• Embed observability early in system and service design through cross‑functional partnership.
• Communicate health, maturity, and tradeoffs clearly while influencing org-wide standards.

Governance & Measurement

• Set guardrails for telemetry quality, retention, and privacy while maintaining team autonomy.
• Drive adoption through documentation, golden paths, training, and DevEx‑focused success metrics.

Skills & Experience We’re Seeking:

• 15+ years of experience in software engineering, platform engineering, SRE, or related roles
• 5+ years leading technical teams or large cross-functional initiatives
• Deep expertise in observability fundamentals: metrics, logs, traces, alerting, SLIs/SLOs, and incident analysis
• Strong hands-on experience building open-source observability platforms at scale
• Proven expertise with OpenTelemetry (instrumentation, collectors, pipelines, and standards) in production environments
• Experience operating and scaling VictoriaMetrics (or VictoriaMetrics cluster) for high-cardinality, high-volume metrics workloads
• Strong understanding of cloud-native and distributed systems (Kubernetes, microservices, service meshes)
• Demonstrated ability to design developer-first platforms that emphasize self-service, usability, and fast feedback

Additional Preferred Qualifications:

• Experience standardizing observability using vendor-neutral, open standards
• Familiarity with complementary open-source tooling (e.g., Clickhouse, Elastic, Grafana, Prometheus, Tempo, Loki, Jaeger)
• Experience migrating from proprietary observability tools to open-source or hybrid models
• Strong product mindset applied to internal developer platforms
• Experience balancing developer experience, system reliability, and cost optimization at scale

What Success Looks Like:

• Developers trust observability data and use it daily without friction

• New services are observable by default, with minimal setup

• Debugging and incident response are faster and less disruptive

• Observability is viewed as a developer accelerator, not an operational tax

Reporting Structure:

• Reports to: Senior Director of Observability, AIOps & Testing tools

• Manages: Observability Services & possibly testing tools

About Our Perks & Benefits:

We are determined to create an environment where our employees feel valued, understand our business goals, and are motivated.

Here's a look at just some of the perks and benefits we make available to our US-based employees:

• Medical & Dental
• 401(k) Savings Plan
• Generous paid time off
• Life Milestones - from adoption assistance, childcare resources, pet insurance, and more, Comcast supports you at all life stages.
• Courtesy Services - We offer all of our full-time employees in serviceable areas free digital TV and internet.
• Discount tickets for Universal Resorts, including theme park tickets and onsite hotel rooms.

Learn more at jobs.comcast.com/benefits

Reasonable Accommodation

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, perform essential job functions, and receive other benefits and privileges of employment. Please contact us to request an accommodation.

Disclaimer:

• This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Job Profile: Director 1, Software Development & Engineering

Comcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.

Skills:

Leadership; Software Engineering; Telemetry

Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality - to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.

Education

Bachelor's Degree

While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.

Relevant Work Experience

10 Years +