Hadoop Principal Member of Technical Staff - AT & T
Bedminster, NJ
About the Job
Job Description:
Join AT&T and reimagine the communications and technologies that connect the world. Our Chief Security Office ensures that our assets are safeguarded through truthful transparency, enforce accountability and master cybersecurity to stay ahead of threats. Bring your bold ideas and fearless risk-taking to redefine connectivity and transform how the world shares stories and experiences that matter. When you step into a career with AT&T, you won’t just imagine the future-you’ll create it.
The Hadoop Principal Member of Technical Staff Cybersecurity Developer will design, develop, and maintain big data solutions. The successful candidate will have deep expertise in the Hadoop ecosystem, experience with large-scale data processing, and a passion for optimizing data workflows. This position requires strong problem-solving skills, a solid understanding of data architecture, and experience working with distributed systems.
Key Roles and Responsibilities:
Design & Development:
Architect and implement big data applications using Hadoop, HDFS, MapReduce, Hive, HBase, Spark, and other Hadoop ecosystem tools.
Develop and maintain scalable, high-performance data pipelines for processing large datasets.
Implement data extraction, transformation, and loading (ETL) solutions for large-scale data sets.
Data Management:
Manage and optimize data storage, ensuring efficiency and scalability.
Perform data validation and ensure data quality across large datasets.
Build and maintain metadata, data lineage, and cataloging for all data systems.
Collaboration:
Work closely with data architects, business analysts, and data scientists to ensure the solutions meet the business requirements.
Security & Compliance:
Implement and maintain security measures in Hadoop clusters, ensuring adherence to data governance and compliance requirements.
Data Processing Frameworks:
Develop and support data processing frameworks using MapReduce, and ODP.
Automation & Scripting:
Automate workflows and jobs using scripting languages like Python, Bash, or similar technologies.
Data Quality & Monitoring:
Implement monitoring solutions for job performance, cluster health, and data quality to proactively address potential issues.
Soft Skills:
Strong analytical and problem-solving skills.
Excellent communication and collaboration skills.
Ability to work independently and manage multiple tasks simultaneously.
Leadership abilities and mentoring experience
Provide guidance to junior developers and assist in shaping best practices for Hadoop development.
Education: Candidates must meet 1 of the criteria below:
PhD in an approved field from an approved university with a minimum of 4 years of relevant experience
Masters in an approved field from an approved university with a minimum of 6 years of relevant experience
Bachelors in an approved field from an approved university with a minimum of 8 years of relevant experience.
Qualifications:
Proven experience in testing applications built on Hadoop technologies.
Solid understanding of Hadoop ecosystem components, including HDFS, MapReduce, Hive, Kafka, Spark, Docker, etc.
Strong working knowledge of Linux, Unix, Python, and networking.
Experience with testing frameworks and tools for Hadoop applications.
Strong SQL skills for data validation and querying within Hadoop environments.
Familiarity with version control systems and continuous integration/continuous deployment (CI/CD) pipelines.
Excellent problem-solving and analytical skills.
Effective communication and collaboration skills in a team-oriented environment.
Relevant certifications (e.g., Certified Information Systems Security Professional - CISSP, Certified Ethical Hacker - CEH) are a plus.
Required Daily Office Presence (5 days a week) in one of the listed locations. No relocation assistance is provided.
Our Principal Member Technical Staff earns between $169,000-$270,400.00 USD Annual, Not to mention all the other amazing rewards that working at AT&T offers. Individual starting salary within this range may depend on geography, experience, expertise, and education/training.
Joining our team comes with amazing perks and benefits:
Medical/Dental/Vision coverage
401(k) plan
Tuition reimbursement program
Paid Time Off and Holidays (based on date of hire, at least 23 days of vacation each year and 9 company-designated holidays)
Paid Parental Leave
Paid Caregiver Leave
Additional sick leave beyond what state and local law require may be available but is unprotected
Adoption Reimbursement
Disability Benefits (short term and long term)
Life and Accidental Death Insurance
Supplemental benefit programs: critical illness/accident hospital indemnity/group legal
Employee Assistance Programs (EAP)
Extensive employee wellness programs
Employee discounts up to 50% off on eligible AT&T mobility plans and accessories, AT&T internet (and fiber where available) and AT&T phone.
#LI-Onsite – Full-time office role
AT&T is leading the way to the future – for customers, businesses and the industry. We're developing new technologies to make it easier for our customers to stay connected to their world. Together, we’ve built a premier integrated communications and entertainment company and an amazing place to work and grow. Team up with industry innovators every time you walk into work, creating the world you always imagined. Ready to #transformdigital with us?
Apply now!
Weekly Hours:
40Time Type:
RegularLocation:
Middletown, New JerseySalary Range:
$160,900.00 - $270,400.00It is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities.