Principal Solutions Architect

Halvik is seeking an experienced Tech Lead - Principal Solutions Architect. This position will be responsible for serving as the primary data warehouse architect for a data services/visualization platform for a federal agency. The architect will lead the design of data lakes, data warehouses, and visualization services for that data. The architect will work with data/cloud engineers to design data pipelines to ingest, clean and transform both batch and streaming data.

Specific roles inside an AWS environment include:

Leading the design of data warehouses, data lakes and datamarts including both the logical and physical models.

Assist in soliciting and assessing requirements for the data warehouses/data lakes among data consumers/analysts, visualization specialists, programmers, and engineers.

Optimizing the design and tuning the performance of data warehouses for efficient loading and high performance for data queries

Facilitating change control processes for the data model within the repositories including integrating with CI/CD pipelines

Designing and implementing a metadata repository to be used for data discovery/catalog services across the enterprise.

Required Skills:

Data Warehousing/Data Architect Experience (10+ years)

Architecting a data lake and/or data warehouse model including defining the use of standard conventions using cloud components (AWS S3, Databricks, Palantir Foundry, AWS Redshift, AWS Aurora Postgres)

Creating logical and physical data models for data repositories containing a number of heterogenous sources

Optimizing data warehouses for high performance for varying types of use cases (high frequency loads, large loads, high frequency queries)

Implementing various archiving and partitioning approaches to optimize data ingestion, data storage costs and meet data retention requirements

Designing strategies for handling slowly changing dimensions

Preferred Skills:

Ability to communicate effectively with senior leadership including translating complex technical concepts into specific and understandable technology recommendations

Experience working in a Palantir Foundry environment including use of Code Repositories, Ontology, and visualization tools like Contour, Quiver and Workshop

Use of integrating visualization tools, such as Tableau, Qlik, Socrata, with data lakes and data warehouses (2+ years)

Data Cataloging Experience (2+ years)

Architecting a data cataloging strategy for a myriad of data sources pulled into a data lake and warehouse

Implementing a data catalogue on a cloud platform

System Architecture Experience (5+ years)

Architecting and manager the security roles for a data lake and pipelines

Use of Infrastructure as Code (IaC) tools to deploy pipelines and components

Technical Documentation (5+ years)

Developing and delivering quality technical documentation deliverables on designed solutions

Defining, guiding and contributing to complete documentation for development efforts