Data Architect (DBT+ Snowflake)

About InfoCepts

At InfoCepts, we are dedicated to helping organizations modernize their data infrastructure. We provide innovative, best-in-class data and analytics solutions to drive modernization, acting as an adaptable and innovative partner for data-driven transformation.

Position Overview

The Cloud Data Architect will spearhead the design and implementation of a contemporary cloud-based data platform. This involves collaborating with stakeholders to migrate existing SQL Server SSIS workloads to Snowflake, utilizing dbt-based ELT frameworks. The role is crucial for defining scalable, reliable, and governed data transformation architecture that aligns with business objectives. The architect will provide essential architectural oversight and guidance to delivery teams, ensuring solution coherence across all project phases.

Key Result Areas and Activities

• Define the target architecture for migrating SSIS to Snowflake with dbt.
• Establish a robust pipeline architecture and a dbt-based transformation framework, encompassing staging, intermediate, and mart layers.
• Lead and execute the conversion of SSIS packages into dbt models, leveraging AI tools like SnowConvert/Cortex Code AI with human oversight and manual refactoring to ensure consistency and scalability.
• Develop and enforce best practices for naming conventions, data modeling, performance optimization, and cost efficiency within the Snowflake environment.
• Design comprehensive strategies for data validation, reconciliation, end-to-end testing, and parallel runs to ensure migration accuracy.
• Provide architectural guidance to ensure adherence to established standards and the overall solution design.
• Collaborate closely with stakeholders to align the migration approach with critical business needs.
• Support the implementation of governance, documentation, and data lineage approaches to ensure audit readiness.
• Facilitate the adoption of CI/CD practices and version control for dbt deployments.
• Proactively identify potential risks and recommend effective mitigation strategies throughout the migration lifecycle.

Essential Skills

• Extensive hands-on experience with Snowflake architecture, data engineering, and data warehouse design.
• Proficiency with the dbt transformation framework and ELT concepts.
• Proven experience in SSIS to Snowflake migration programs or similar legacy ETL to ELT transitions.
• Strong SQL proficiency and expertise in data modeling, particularly dimensional modeling.
• Experience in defining and implementing data validation and reconciliation frameworks.
• Solid understanding of performance tuning and workload optimization techniques within Snowflake.
• Familiarity with CI/CD pipelines and version control systems like Git or Azure DevOps.
• Experience guiding teams through delivery, User Acceptance Testing (UAT), and productionization, including release planning.

Desirable Skills

• Experience with migration accelerators or reusable frameworks.
• Exposure to data governance and lineage tools.
• Knowledge of Terraform or other infrastructure automation tools.
• Experience working on distributed or multi-team migration projects.

Additional Information

The company is committed to ensuring a smooth migration process, focusing on architectural integrity, performance, and cost-efficiency. Strong collaboration and communication are key to success in this role.