NOSQL Principal Database Engineer at Confidential company
About the Job
Summary
Tllis is an exciting opportunity for an experienced senior developer of large-scale data solutions. You will join a team delivering a transformative next gen cloud hosted data platform.
Tile ideal candidate will have a proven track record in implementing NoSQL data stores, real-time event data streaming and transformation pipelines for large scale organizations. We are seeking someone with deep technical skills in a variety of technologies to play an important role in developing and delivering early proofs of concept and production implementation requiring high TPS (1000+ transactions/second). Tile successful candidate will have hands-on experience in a multitude of data domains; including, but not limited to;24 x 7 x 365 enterprise and cloud database infrastructure design and management, security, database design, database development, database tuning, service delivery, incident tracking, and change management.
Responsibilities
- Architecting and managing various OLTP application data models associated primarily with NoSQL DBs (Cosmos DB) and additionally Relational DBs (Azure SOL, MS SQL Server or similar)
- Ensuring database features and capabilities are incorporated into data model designs to optimize performance, resiliency, and scalability (with millions of active accounts transacting with very high TPS)
- Architecting and designing enterprise-wide data strategy for data modeling, data pipelines, and data integrations across various environments and technology stacks
- Designing and implementing performant data movement pipelines using real-time event data streams (Apache Kafka, Azure Event Hub, AWS Kinesis, etc)
- Defining and documenting enterprise-wide database standards, patterns & best practice for larger scale adoption for accelerated delivery around data domains
- Bringing thought leadership through understanding the key business objectives and strategically providing data integration solutions to support various data domains
- Clear understanding of Entity Framework concepts and database design supporting microservices architecture development patterns
- Ensuring data security and privacy standards are implemented, including- role-based security, encryption, tokenization, and obfuscation
- Performing problem-solving of application issues and production errors, including hign-level critical production issues that require immediate attention
- Developing the data architecture and governance models for systems of engagement and providing the framework for integrating source
- systems with the transactional databases and/or data warehouse; Ensuring data architectural designs are consistent, maintainable, flexible, extensible, and cost-effective
- Leading and mentoring a team of data engineers by setting standards and best practices for designing and architecting cloud-based data and reporting applications
Qualifications
- Bachelors and/or Masters degree in Computer Science, Computer Engineering or related field preferred
- 12+ years of overall software development experience required (With heavy focus on database centric development)
- 4+ years of hands-on development experience with combination of NoSQL DBs (Cosmos DB, MongoDB/Cassandra or similar)
- 1+ year of hands-on development experience with Azure Cosmos DB
- 2+ years of hands-on development experience with event based streaming technologies (Apache Kafka/Azure Event Hub or similar)
- Strong Knowledge and experience in data modeling & design With relational and NoSQL DBs
- Experience with RDMBS (primarily MS SQL Server and Azure SQL); proficiency with advanced SQL concepts (T-SQL, Pl/SQL, etc.) that process millions of transactions daily with very high processing rates to support mission-critical databases
- Advanced understanding of SQL engine internals to help design and tune databases to get the optimal performance
- Experience building and scaling distributed, highly available systems in cloud env (Azure/AWS)
- Expertise in understanding complex business needs, analyzing, designing, and developing solutions
- Experience working in a Dev/Ops environment with tools such as Azure Dev Ops, Microsoft VisualStudio Team Services, chef, Puppet or Terraform
- Experience in handling structured and semi-structured data forms like JSON/XML and normalization of data structures