Matillion

Matillion Usability

Kommentare: I really like Matillion ETL but I was a bit disappointed with some of its limitations and quirks, like when Twitter updated his API all my jobs stopped working and the only thing I could do was develop everything again without using the Matillion component. When I was trying to make upsert procedures on RDS Databases, I was thrilled that the Matillion component has that option, bit it simply didn't work. It seems like these functionalities haven't got the same attention of the others, I contacted the Matillion support which is simply great and these things are still going to be fixed. When I wanted specific libraries of Python, I couldn't get it working on my instance because pip was out of date and it couldn't be updated. I tried to update and I messed up with my instance. Overall, Matillion is great, when you're creating a flow of data migration and you need to parse the data before and do some automations, but there are some cases when you need something a little more specific, that's when it becomes a pain.

Vorteile:

The ease to use, Matillion has a great set of tools that make complex and difficult process more simple and fast to develop.

Nachteile:

There are many tools in Matillion that doesn't have enough attention and because of that these tools are fragile, while some of them do not work.

Matillion Review

Kommentare: We're using Matillion for all the ETL in our environement: 3000 employees, around 500 BI users, around 30 different systems that we connected to. We were able to switch some existing jobs from Talend and create a whole lot more in just 6 minutes.

Vorteile:

+ Fast & easy to use + Completely embedded into AWS environement + Comes light, it's not overloaded with stuff no one uses + Some really innovative features

Nachteile:

- Sometimes feels like not "fully under control", e.g. when a component runs into an OutOfMemory, the whole environement crashes. And there are different ways to trigger that... - Scheduling overview could be more sophisticated, it's kind of hard to have a proper overview there - Variable handling seems sometimes to be a bit difficult, e.g. when setting it in one process, it's not always set in sub-jobs - In some cases, one can see that Matillion is still "under development": Same features are available in some components, but are missing in others

Very productive toolset

Kommentare: We are using it to do the extract load and transfer for our data warehouse

Vorteile:

- Quick to start - Consumption based model - Works well with Snowflake

Nachteile:

- Harder to find resources with skills - Cost relatively higher

Best and very much compatible ETL for Redshift

Vorteile:

1.)All the components and transfomrations availability 2.)Specially oriented for data ingestion process using all aws services like rds, s3, sns, redshift 3.)easy admin, ssl setup 4.)very easy diagromatical representation of jobs

Nachteile:

the latest button change for "switch version"

First class ETL for everyone

Kommentare: We've been able to concentrate all data sources in one place and do a proper transformation and normalization of data to feed the Visualization layer.

Vorteile:

Easy to use for non-tech (engineers) users.

Nachteile:

Lacks testing stage before production and more flexibility to sample data.

Matillion Review

Vorteile:

Matillion is very easy to use. It's simplicity allows you to drag an drop components to easily create orchestrations. It also simple to create shared jobs and use the components.

Nachteile:

Although there is a decent set of components, they are not very versatile, hence I end up using a SQL script instead. For example, the S3 unload component does not allow one to specify some criteria and some fields are mandatory whereas I would not have to specify such specific criteria when doing this from an SQL script.

Is Great

Kommentare: Overall extract and load data strategies is very powerfull

Vorteile:

Is easy and is real pay as you use, that is very important for latinoamerica business

Nachteile:

That you can't write in other destinations

Great tool and experience

Kommentare: Great tool

Vorteile:

Easy to use, graphical way to do data flows on Google Cloud

Nachteile:

The most missing functionality, is to be able to setup data destinations additionally to BigQuery

Good

Kommentare: Overall Matillion is good and I'm sure it could be better.

Vorteile:

I like the stability of the product. We haven't updated our version since we started.

Nachteile:

Can't use simple SQL Functions like CURRENT_DATE in FIlter Component. And no Automatic Update.

Most effective Cloud Based Data Integration And Transformation Platform

Kommentare: Amazing ETL options.

Vorteile:

The platform is very user-friendly since it is based on drag and drop functions it makes the whole process easy and can be done by anyone. It is the best option since it is based on pay as you go so we can pay as much as we use. This has saved me a lot of money.

Nachteile:

There are no negatives I have noted till now all the services are top-notch and up to the industry mark. This has helped a lot of engineers and businesses transform and automate their data.

Need on the fly connectivity to different instance of Redshift

Vorteile:

I like the bunch of API integrated in Matillion it helps me to directly grab the data from different sources without manually extra and import in my database.

Nachteile:

I am using Matillion for Redshift from last more than 2 years. When i setup a project in Matillion with connection to a Redshift cluster, sometimes there is a need to extract the data from other instance of Redshift while running job in Matillion. In that case there is straight forward way of getting the data from other instance of Redshift like you have comments to extract the data from databases like SQL Server, Oracle etc. instead of first i need to run another job by connection second Redshift cluster and extract the records after that run different job to load the extracted records from S3 to main Redshift cluster.

Great data tool!

Kommentare: Great. Good customer service, quality product.

Vorteile:

Makes for very fast development with lots of built in connectors. Visual layout of complex data pipelines is a big plus.

Nachteile:

Out of memory errors. We use this for a lot of production applications. After 1 year of trying to fix OOM errors and doubling our instance size, we still get them monthly. I love matillion but I wish it were more reliable. The billing structure contributes to the problem as well. We can't run matillion on a big instance without significantly increasing our licensing fees. I wish they were independant.

Matillion when used with Google BigQuery

Kommentare: We are now using Matillion as our TL tool to load into our Google Data Lake which will be the source of all our BI reporting data (replacing SQL servers).
Matillion is easy to install (Google Marketplace, one click build), easy to use initially, sometimes lacks a few specialist bits (usually around new things in the Google estate), but theses can be overcome by using scripts or sql statements and I am sure some will become components in their own right.
Matillion support is very good - I usually get a response within the hour

Vorteile:

From an engineers point of view one of the selling points for Matillion (apart from the absolute simplicity of use - at least to start with) is that it produces its own documentation !!

Nachteile:

Sometimes the error messages can be confusing , but this is often down to the messages coming from BigQuery. Its also not always obvious that it is producing SQL statement 'under the hood' and that can mean breaking sql statement size limits without realising it

A Great Cloud-based Tool

Kommentare: I like it overall. It is easy to quickly learn and get up to speed. It is made to work in the environment I'm working in (AWS) and has a nice, clean browser-based interface to build and schedule jobs in EC2. Email-based support is responsive. However, I sometimes feel it is too expensive compared to alternatives for the value it adds and the ELT model, while beneficial in many ways, hamstrings the component feature-set.

Vorteile:

Well integrated with AWS. Great browser-based interface. Develop in the same place where the code will run, as opposed to other solutions I use that develop in Windows and run in Linux. Easy to schedule.

Nachteile:

I have mixed feelings on the overall value. The hourly rate really adds up over time. This is probably my biggest misgiving. Otherwise, I sometimes get frustrated with the ELT model because it means if the feature you need isn't supported within Redshift, it's up to you to create Python scripts or Bash scripts to enable it.

MELT

Vorteile:

Easy to learn and use. The knowledge from other products is transferable. The documentation is amazing (one probably cannot understand how good without the experience). Support is always available and of good quality.

Nachteile:

There is no restart-from-point-of-failure option for failed loads. Everything has to start from scratch or remaining jobs need to be run manually.

Good ease of use, should improve customer service

Kommentare: With the tools given most of the business problems can be solved(not in an efficient way though if you consider SnowFlake), but there's a lot of room for improvement on the customer service side. Also, having the same functionalities for both RedShift and SnowFlake would make it a lot better, for now there are more functionalities and components for RedShift.

Vorteile:

The tool was very easy to use and was intuitive most of the time. The functions and components for RedShift were amazing even though I didn't use them

Nachteile:

1. Initially the customer service was good, calls were being scheduled either on the same day or on the next day. But once you start using it, support calls would take weeks. Sometimes support will say they'll get back to you but they don't. 2. In one particular instance, a support executive said they would get back to me because they couldn't find an immediate solution, but even after 3 weeks there was absolutely no response on their side. I got a reply after I followed up again though. 3. There are good amount of components for RedShift which are not available for SnowFlake, I hope they would incorporate them as soon as possible.

Does the job very well

Kommentare: I have been using Matillion since September 2018 and at the beginning i didn't like it very much as i dont had hands on experience using Matillion. But later my work has increased a lot using Matillion. So far i have had integrated bunch of sources using Matillion to data warehouse. I am liking it at this moment and no complains.

Vorteile:

Matillion ETL is web based ETL tool and very easy to use from anywhere. It has most of the connectors for all data sources which makes my job to complete end to end development.

Nachteile:

One thing I did not like about Matillion is, there is no need of Transformation job. Everything should be done at one place(Should be in Orchestration job). Also, the list of components are different in Orchestration and transformation jobs.

Review of Matillion as ETL cloud Engineer

Kommentare: It was great working as well learning experience , hope Matillion will come up as industry leader.

Vorteile:

Matillion integration with AWS services is flawless and has real time impact in batch jobs pulling data from on-premises to cloud platform.

Nachteile:

Restricting the number of user can access Matillion, Lot's of time huge data set get stuck and fail with many other issues lastly better full log specifically for Developer to debug the issues.

Simple and easy ELT

Kommentare: Very nice. Easy and simple tool. Yet a lot possible with python scripting feature.

Vorteile:

Integration with GCP API calls and cloud storage. Easy of access from anywhere. Self documentation. Customer service. Automatic updates.

Nachteile:

Failure capture process. Any changes made not needing to be saved. Accidental changes are considered saved at click of the button. No front end customisation available to distinguish between different environments. Having to use 3rd party add ons.

Good tool for workflow management

Kommentare: I am happy with this tool and it has good UI.

Vorteile:

- It has very good UI to design the workflow. - It is easy to design the workflow. - It has very good support with persistence storage. Like snowflake, redshift, etc.

Nachteile:

- It should also support Azure data warehouse.

Fast track to results

Kommentare: Very helpful support which takes care of all our problems, especially with "stupid" beginner questions.

Vorteile:

Very easy to use and very easy to get results. Fast implementation cycles compared to other tools. Best is to loop over variables which enables simple but powerful solutions.

Nachteile:

Sometimes more flexibilty on specific tasks, e.g. Excel import or csv.

Intuitive & Flexible

Vorteile:

I love the GUI that Matillion employs - it makes creating and adjusting tasks very simple and transparent.

Nachteile:

The scheduling of tasks is a little tricky, as we have to separately have to schedule the virtual machine to fire up and down. Once this is done though, it works faultlessly.

Simple easy-to-use Interface but looks like a development in progress software

Vorteile:

Simple with not a lot of unnecessary components. Very easy to use with Amazon Redshift.

Nachteile:

Licensing mechanism not good. We had problem when trying to increase license to 6 person from 5. Integrating with Git or other source control tool not easy.

User friendly and Advance connectors

Kommentare: I was developed around 20 to 50 mapping using Matillion and I don't see any difficulties right know.

Vorteile:

User interface is very easy and any one can mange development things without too much of knowledge. Matillion have very content on official site and It help's a lot to make hands on on this tool. In few click we can connect any database weather it is on premises or cloud. I have extracted data from different source system and loaded in to redshift in very easy and fast manner.

Nachteile:

I don't see straight forward job Audit framework. Please try to build nice job monitoring and audit framework.

Using Matillion with AWS Redshift

Vorteile:

Easy to understand and follow processes. Easy to pass variable values between jobs. Works well with Redshift and S3.

Nachteile:

Use of API's can be a little confusing to setup/configure.