Link
Search
Menu
Expand
Document
Virtues
Virtue
What are virtues?
Proposal
Principle
Standard
Pattern
Quick Start
Next Steps
Identification
Tags
Virtue Model
Agenda
Agenda
Principle
about
Business Intelligence
Data Visualisation
Data Export From Visualisation Tools
Data Integration
Batch ETL
Read VARIANT through VIEW
S3 to Staging Pipeline
Data Development
Load data as far as possible as soon as possible
One Way In
One Way Out
Process All Data
Retain As-Received Data
Source Once, Use Many Times
Store Record Level Data
Data Federation
Access Controls
Data Security
Data Source
Data Utilisation
Descriptive Info
Fact Structures
Multi Brand Multi Channel
Naming Standards
No Data Quality Metrics
No Re-Engineering
Synonymous With the Presentation Layer
ownership
Data Storage
Data Architecture Management
ASPIRE Data Model Principles
Create Consistent Keys
Legal and Binding Compliance
Share Data
Data Warehousing
Data Immutability
Data Persistence
Maintain Change History
Snowflake Private link
Governance
Data Definition
Common Controlled Vocabulary
Data Classification
Metadata Management
No Data Without Metadata
Single source of truth for all principles, standards and patterns
Single source of truth for the Aspire Blueprint
Product Governance
Capabilities First
Standard
about
Data Integration
Batch ETL
Data Development
Data Quality Audit Specification
Data Sharing Standards For External Consumers
Ingestion Standards for Graph Database
Data Federation
Data Migration
Single Storage Integration Per AWS Landing Account
Data Storage
Data Architecture Management
ADW Integration Layer Model Standards
ADW Naming Conventions
ADW Presentation Layer Model Standards
ADW Staging Layer Conventions
ADW Technical Column Standards
Logical Data Model Standards
Split PL Schemas by IRM
Temporary Schema
Transform Schema
Data Warehousing
ASPIRe Data Warehouse Naming Conventions
Aspire Data Warehouse Design Artefacts Deprecation Standards
Aspire Data Warehouse IRM tagging standards
Aspire Data Warehouse RDV Immutability Standards
Data Experimentation
Hashed and Encrypted Column Naming Conventions
Object Structure Conventions
Snowflake Time Travel
Snowflake warehouse default auto-suspend time
Governance
Data Definition
Data Classification
Data Governance
Snowflake Query Tags
Snowflake Role Permissions
Data Retention
S3 Landing 90 Day Retention
Metadata Management
Single repository for all principles, standards and patterns
Single repository for the Aspire Blueprint
Product Governance
Snowflake Release Cycle
Security
Authentication
Key Based Snowflake Service User Authentication
MFA mandatory for Snowflake ADMIN users
Service User RSA Key Rotation
Data Security Management
Key Management
Snowflake Service User Usage
Service Connectivity
Connecting AWS Accounts to Snowflake
Pattern
about
Data Integration
Batch ETL
ETL pipeline access to staging data
Reloading data from Staging
S3 to Staging Pipeline
Snowflake Streams for Staging Increments
Data Development
Data Sharing Pattern for External Consumers
Ingestion Pattern for Graph Database
S3 Raw Bucket Naming Convention
Data Federation
Argos Federation
Data Storage
Data Warehousing
Scratch Schema
Staging Table Structure
Governance
Data Definition
Data Classification
Security
Service Connectivity
Connecting AWS Accounts to Snowflake
Proposal
Apply S3 Intelligent Tiering By Default
Authentication
Authorisation
Business Logic Not In Reporting Tools
Capabilities First
Clone Based Feature Engineering And Testing
Data Classification
Data Federation Principles
Data Sharing with External Consumers
Decouple Curated
Enable Lockbox and Key Rotation
Export of Data from MSTR to Excel
Group and Role Abstraction
Identifying Staging Data Increments Using Streams
Identity Integration
Ingestion Standards for Graph Database
Limit our investment in SAS capacity
Machine-Learning Architecture
Network Integration
OpCo Independence
Persist ADW Staging
PoC Freedom
Prefer API to Custom Client Tools
Prefer Cloud to On Premise Integrations
Private Link for Snowflake Connection
Proposal for Common Integration Model (CIM)
Proposal for Federated Layer
Separate Data Environment Layers
Sharing ELT & DQ Events
Siesta S3 Bucket Naming Conventions
Snowflake Query Tags
Snowflake Release Cycle
Snowflake Scratch Space
Snowflake Tagging
Stub Hub
Transform Schema
Transform Schema Naming Standards
Virtues on GitHub
Agenda for 2021-09-27
item
owner
DECISION: Graph Database Ingestion Standards
Singh, Sujata