Open in app

Sign In

Write

Sign In

Arun Singh
Arun Singh

6 Followers

Home

About

Sep 12, 2022

In-memory databases: use cases and pros-cons

In-memory databases are a valuable and attractive alternative to traditional databases that rely on the physical storage of data. Here are a few use cases where the incredibly high speeds offered by an in-memory database may outweigh the downside of less stable data. Ecommerce Storing a small component on an ecommerce…

Database

4 min read

Database

4 min read


Jun 3, 2022

Need to align Data strategy with business strategy

Creating a Data Strategy Big data revolution has sparked a trend among organizations to collect all possible data. Cheap storage and processing capabilities offered by hyperscale's of today have ignited this trend further, which has resulted abundance of data. Everyone is capturing and storing this data in multiple ways and “Data Lake” is one…

Data Strategy

2 min read

Need to align Data strategy with business strategy
Need to align Data strategy with business strategy
Data Strategy

2 min read


Jun 3, 2022

Common Data Integration Patterns

Data exchange between applications is a key requirement. An organization will typically have a large set of applications in its IT landscape and will require them exchange data on regular basis to accomplish business objectives. A data integration pattern is a standardized method for integrating data. …

Data Integration

2 min read

Data Integration

2 min read


Apr 29, 2022

OOPs Design Patterns (Gang of four)

A list of design patterns, one must keep in arsenal :) 1. Strategy: Defines a family of algorithms, encapsulates each one, and make them interchangeable. Strategy lets the algorithm vary independently from clients who use it. 2. Decorator: Attach additional responsibilities to an object dynamically. …

Design Patterns

3 min read

Design Patterns

3 min read


Apr 29, 2022

Data Governance using Azure Purview

Growth of data creation is unprecedented in current times and is expected to grow explode in near future. Ever since storage and data processing/computation capabilities have enhanced, it led to capturing every bit of data. It is available for analysis and deliver insight within. https://www.statista.com/chart/17727/global-data-creation-forecasts/ As per “statista”, data creation…

Data Governance

2 min read

Data Governance

2 min read


Mar 1, 2021

NiFi: An Architecture Overview

Apache NiFi Overview Apache NiFi is a dataflow system based on the concepts of flow-based programming. It supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic. NiFi has a web-based user interface for design, control, feedback, and monitoring of dataflows. It is highly configurable along…

Apache Nifi

9 min read

NiFi: An Architecture Overview
NiFi: An Architecture Overview
Apache Nifi

9 min read


Feb 10, 2021

How to configure incremental models in DBT ?

What is an incremental model? A common need in building models in data warehouse is to build models/tables incrementally and not truncate/load or drop/load every time. This is an effective strategy to build tables with optimized resource consumption. When building Incremental models as tables in your data warehouse — the…

Dbt

2 min read

How to configure incremental models in DBT ?
How to configure incremental models in DBT ?
Dbt

2 min read


Feb 9, 2021

Azure Data Factory pipeline with Snowflake and DBT

A data pipeline is a series of data processing steps. If the data is not currently loaded into the data platform, then it is ingested at the beginning of the pipeline. Then there are a series of steps in which each step delivers an output that is the input to…

Dbt

3 min read

Azure Data Factory pipeline with Snowflake and DBT
Azure Data Factory pipeline with Snowflake and DBT
Dbt

3 min read


Feb 8, 2021

Extracting Data from SAP DSO in Azure Data Factory

Extracting Data from SAP DSO in Azure Data Factory There are many types of data stores available in SAP. DSO is one such data stores and has a unique feature to maintain data. DataStore Object (DSO) is used to store data at the most granular form, i.e. at document level. …

Sap

3 min read

Extracting Data from SAP DSO in Azure Data Factory
Extracting Data from SAP DSO in Azure Data Factory
Sap

3 min read

Arun Singh

Arun Singh

6 Followers

Work as Enterprise Data Architect, Cloud Data Architect and focuses on building data architectures on cloud platforms. www.linkedin.com/in/arun-k-singh-3221372

Following
  • Pinterest Engineering

    Pinterest Engineering

  • Shashi Sastry

    Shashi Sastry

  • Global Technology

    Global Technology

  • Dagster Blog

    Dagster Blog

  • Sascha Heyer

    Sascha Heyer

See all (20)

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech

Teams