Solid Media
  • Services
  • Amorphic
  • Solutions
    • Energy Data Cloud
  • Resources
    • All
    • Blog
    • Case Studies
    • Press Releases
    • Whitepapers
  • About
  • Contact Us

Resources

How Much Does it Cost to Build and Manage a Data Lake?

Published On - November 10, 2022   |    1 Minute Read
Arun Palathumpattu
How Much Does it Cost to Build and Manage a Data Lake?

 

From our experience of building data lakes for customers on AWS, it could cost anywhere between 200K - 1M USD depending on the complexity and number of features they want. For you to understand the above numbers please refer to my earlier post “Journey of Building a Data Lake on AWS - from Ideation to Business Value” where I outlined the journey of setting up an enterprise data lake.

As mentioned in my earlier post there are two distinct types of customers interested in building data lakes. Those who need to build a sophisticated data lake platform and those who need to build a use-case driven data lake with limited features.

How-much-does-it-cost-to-build-a-DL-Fig1

Figure 1 simplifies the step diagram from the previous post. In summary, one-month POC effort would cost 40K whereas a three-month effort to get a single use case base data lake into production with CI/CD automation for infrastructure and minimum security features would cost around 200K USD.

For a high-end enterprise data lake platform, this can go as high as 1M USD.  It is worth mentioning that a majority of the cost for the data lake implementation phase will be for skilled manpower. AWS infrastructure cost will be minimal to build the data lake because of the server-less architecture. The cost of building an enterprise data lake on AWS is still significantly less than building an on-premises Hadoop data lake.

Ongoing management and support of an enterprise data lake platform will require at least 40% of the resources used during the build phase. If you had 10+ resources in the initial build phase, then you need at least 4 resources for ongoing management and support.

We have provided the above cost estimates based on our experience helping multiple customers ranging from small companies to big enterprises with their AWS data lake strategy and implementation. The actual cost may vary for a new data lake build depending on the features, complexity, security and governance requirements of the customer.

Cloudwick - Data lake eBook

 

Facebook Twitter LinkedIn WhatsApp
Previous Post [Press Release] Cloudwick selected as a launch partner for Amazon HealthLake Next Post Cloudwick’s Amorphic Genomics Data Cloud

    CATEGORIES

    • Blog (4)
    • Blogs (1)
    • Case Studies (9)
    • Data Lakes (1)
    • Government (1)
    • Healthcare (2)
    • Home_pos1 (1)
    • Home_pos2 (1)
    • Home_pos3 (1)
    • Press Release (2)
    • White Papers (1)
    see all topics

    RECENT POSTS

    How The Essex Centre for Data Analytics (ECDA) uses Amorphic to govern their data lake
    How The Essex Centre for Data Analytics (ECDA)...
    16 November, 2022
    Cloudwick’s Amorphic Genomics Data Cloud
    Cloudwick’s Amorphic Genomics Data Cloud
    16 November, 2022
    [Press Release] Cloudwick selected as a launch partner for Amazon HealthLake
    [Press Release] Cloudwick selected as a launch...
    20 October, 2022
    [Blog] The First Fully-Managed AWS Data Cloud Solution for SMB
    [Blog] The First Fully-Managed AWS Data Cloud...
    10 August, 2022
    About

    Cloudwick powers more agile, innovative, and cost-effective cloud data and analytics solutions. Cloudwick's Amorphic Data Cloud simplifies data access by making all data on AWS searchable, shareable, and analyzable, so organizations can gain deeper insights from their data. Cloudwick's Professional Services provides organizations with trusted, high impact data and analytic migration and modernization outcomes.

    Founded in 2010 in Newark, CA, Cloudwick serves customers throughout the US, EMEA, and APAC.  

    Other Links

    Careers

    General Privacy Policy of Cloudwick

    Support, Services, and Legal

    Contact Us

    Office Address
    39899 Balentine Drive,
    Suite 345
    Newark, CA 94560

    Email: sales@cloudwick.com

    © 2023 Cloudwick | All rights reserved.