Data Engineer at Aditi Consulting
San Francisco, CA 94102
About the Job
Summary:
Looking for a Data Engineer, who can help building data pipelines for Web Analytics. The candidate should have experience with the above tools and experience with Web data. Should have experience with end-to-end data engineering process. Experience with Tableau is a plus.
Job Responsibilities:
Build metrics from unstructured data - Chat transcripts, AI Agent product logs, Agent interaction texts
Build metrics from structured data - iceberg tables, Snowflake tables, Salesforce Sales Cloud objects.
Design, develop, and maintain data transformation pipelines using DBT to transform raw data into structured, usable datasets for analytics and reporting.
Collaborate with cross-functional teams including data analysts, software engineers, and product managers to translate business requirements into data-driven solutions that provide actionable insights and enhance customer experiences.
Optimize data storage, retrieval, and processing to support high-performance analytics, ensuring the system scales effectively with increasing data volumes.
Ensure data quality and consistency by implementing automated monitoring, alerting, and validation processes.
Automate and streamline data operations to reduce time-to-insight and enhance data reliability.
Define and uphold data engineering best practices, including code quality, version control, and testing standards.
Support and strengthen data security, privacy, and compliance across all data engineering initiatives to meet industry standards.
Must Have - experience with AWS, dbt, worked with Marketing or Sales data.
Preferred - Work experience with unstructured data and Salesforce objects
Tableau exposure
Tools:
AWS utilities for data Ingestion
dbt for Data Transformation
Airflow for Pipeline orchestration
Custom Data quality framework
Snowflake for storage and Compute
Salesforce Data Cloud as Zero Copy source
Salesforce Sales Cloud as a Source
Compensation:
The pay rate range above is the base hourly pay range that Aditi Consulting reasonably expects to pay someone for this position (compensation may vary outside of this range depending on several factors, including but not limited to, a candidate’s qualifications, skills, competencies, experience, location and end client requirements).
Benefits and Ancillaries:
Medical, dental, vision, PTO benefits and ancillaries may be available for eligible Aditi Consulting employees and vary based on the plan options selected by the employee.
Aditi Consulting LLC uses AI technology to engage candidates during the sourcing process. AI technology is used to gather data only and does not replace human-based decision making in employment decisions.
#AditiConsulting
Looking for a Data Engineer, who can help building data pipelines for Web Analytics. The candidate should have experience with the above tools and experience with Web data. Should have experience with end-to-end data engineering process. Experience with Tableau is a plus.
Job Responsibilities:
Build metrics from unstructured data - Chat transcripts, AI Agent product logs, Agent interaction texts
Build metrics from structured data - iceberg tables, Snowflake tables, Salesforce Sales Cloud objects.
Design, develop, and maintain data transformation pipelines using DBT to transform raw data into structured, usable datasets for analytics and reporting.
Collaborate with cross-functional teams including data analysts, software engineers, and product managers to translate business requirements into data-driven solutions that provide actionable insights and enhance customer experiences.
Optimize data storage, retrieval, and processing to support high-performance analytics, ensuring the system scales effectively with increasing data volumes.
Ensure data quality and consistency by implementing automated monitoring, alerting, and validation processes.
Automate and streamline data operations to reduce time-to-insight and enhance data reliability.
Define and uphold data engineering best practices, including code quality, version control, and testing standards.
Support and strengthen data security, privacy, and compliance across all data engineering initiatives to meet industry standards.
Must Have - experience with AWS, dbt, worked with Marketing or Sales data.
Preferred - Work experience with unstructured data and Salesforce objects
Tableau exposure
Tools:
AWS utilities for data Ingestion
dbt for Data Transformation
Airflow for Pipeline orchestration
Custom Data quality framework
Snowflake for storage and Compute
Salesforce Data Cloud as Zero Copy source
Salesforce Sales Cloud as a Source
Compensation:
The pay rate range above is the base hourly pay range that Aditi Consulting reasonably expects to pay someone for this position (compensation may vary outside of this range depending on several factors, including but not limited to, a candidate’s qualifications, skills, competencies, experience, location and end client requirements).
Benefits and Ancillaries:
Medical, dental, vision, PTO benefits and ancillaries may be available for eligible Aditi Consulting employees and vary based on the plan options selected by the employee.
Aditi Consulting LLC uses AI technology to engage candidates during the sourcing process. AI technology is used to gather data only and does not replace human-based decision making in employment decisions.
#AditiConsulting