[Blog] New Amorphic Data Cloud Features for Amazon Redshift: Real-Time Streaming and SQL-Based Data Transformations

"Cloudwick is proud to be a “Powered By Redshift” partner and leverage the comprehensive data warehouse capabilities of Amazon Redshift to power the Amorphic Data Cloud for AWS. Our capabilities to enable customers to create data transformations with SQL-like statements and to stream customer data directly to Amazon Redshift will transform and accelerate critical customer business processes”

  — Mark Schreiber, General Manager - Cloudwick

Cloudwick’s Amorphic Data Cloud for AWS – June 2022 Feature Release support for Amazon Redshift

Transforming and accelerating critical business processes with Amazon Redshift just became easier with the June 2022 feature release of Cloudwick’s Amorphic Data Cloud (Amorphic) for AWS. Amorphic customers now have greater capacity to leverage the benefits of Amazon Redshift with newly enhanced Amorphic features enabling real-time streaming of data for faster data insights, and new capabilities that make it easier for analysts and business users who don’t have extensive programming language experience to transform data without assistance. Combined with Amorphic Data Cloud data observability enhancements, and new security and governance features, these optimized features for Amazon Redshift enable Amorphic customers to fast-track their access to data and enrich their capacity to analyze, share, and make decisions from their data while developing data products for deeper business insights and greater competitive advantage.

'Powered by Redshift'

In June this year, Cloudwick added the following new features to the Amorphic Data Cloud that enhance your use of data within Amazon Redshift:

• Real-Time Streaming into Amazon Redshift for Data-on-Demand – Customers can now stream data-on-demand directly to Amazon Redshift through Amorphic with no need to stage data in a data lake before moving data to the data warehouse. This feature accelerates and simplifies data ingestion and enables faster time to data insight. Customers can now also choose to build custom connectors capable of ingesting data at scale to better leverage the comprehensive data warehouse capabilities offered by Amazon Redshift.

• Writing Data Transformation in SQL-Like Statements - The Amorphic feature launch includes an integration with DBT (https://www.getdbt.com/) that enables Amorphic customers to write data transformations using SQL-like statements. This makes data transformation accessible to analysts and business users who don’t have extensive experience in other programming languages. Amorphic enables data analysts and business users to directly transform governed and secure data speeds time to high-quality data insights. Enhanced Data Movement with Amazon Redshift DATA APIs - Amorphic now uses Amazon Redshift DATA APIs to improve data movement from Amazon S3 to Redshift. The Data API takes care of managing database connections and buffering data to provide a superior data connection to Redshift using the in-built Amorphic data pipelines.

• Job Prioritization – API support for Workload Manager in Amazon Redshift: Amorphic users can now prioritize the jobs they run. Highest priority jobs will receive priority resources compared to the other jobs, so the most important data analysis gets done first. Please refer to the Amorphic API documentation for more details.

Enhanced Data Observability – Tag-Based Cost Monitoring and Job Monitoring

Knowing where your data is, and how much it costs to store and move your data is essential. The Amorphic Data Cloud cost explorer now includes tag-based cost monitoring to allow customers to monitor more labor-intensive services such as ‘ETL Jobs’,  Deep Search Indices’ and ‘ETL Notebooks’. With these new Amorphic features, customers can see all ETL job executions under the ETL execution history, enabling jobs to be monitored individually when triggered from a scheduler. Additionally, with the proper infrastructure management privileges, customers can now monitor AWS Database Monitoring Service (DMS) in real time, which can greatly simplify the management of multiple active DMS tasks running simultaneously in an environment.

Push Notification and Custom Notifications

With the new features, the Amorphic Data Cloud now offers an API for Push Notifications, which allows customers to set specific notifications to alert users about their subscribed Jobs, Datasets, Insights, Schedules, and Dashboards. The notifications will pop up in the Amorphic console or can be sent as an email.

Amorphic customers can now also create Custom Notifications for Workflows. This feature is useful to manage multiple workflows, for example setting up custom notifications for job completion or for a node failure notification from a set of workflows. Similarly, customers can now create custom notifications for Connections. This feature enables users to receive a notification if a connection is updated/deleted or undergoes access modification.

Security & Governance

With last month's completion of native integration of AWS Lake Formation, the Amorphic Data Cloud now supports Row and Column Level Access Control. Now customers can use this extra fine-grained access control along with the existing Amorphic Role Based Access Control.

Learn More: For more information about Amorphic, or to explore the new features, please contact sales@cloudwick.com, or click here to speak with an expert on my technical team.

About Cloudwick’s Amorphic Data Cloud for AWS

Cloudwick's Amorphic Data Cloud for AWS helps organizations gain deeper insights from their data. Amorphic makes any data shareable, searchable, and analyzable by any analytic user, data scientist or any data-driven application developer. Encompassing a built-in data catalog for search and sharing, enterprise-grade governance and security, along with machine learning (ML) and artificial intelligence (AI) capabilities for advanced analytics, Amorphic provides a production ready, self-service data cloud for all data and all workloads that automates data ingestion and natively integrates over 65 services on AWS - including Amazon Redshift, AWS Glue, and Amazon SageMaker - with “single pane of glass” simplicity for better data-driven decision making with near zero IT development or support required.