Automated-Data-Analytics Product Development

Automated-Data-Analytics Product Development

Analytics
In today’s competitive world, analytics has become must for continuous development. Nowadays, data is available from different data sources. People are analyzing it and making use of it in decision making. Some organizations are finding data insights and providing it to targeted audience. Many data analytics product are being developed. If you have good source of data, data-scientist are able to find useful insights from it. Then you can make use of that data for development. In today’s world, data is available either in static form or in dynamic (real-time). Data is either structured or unstructured. This data can be analyzed using different BI tools. But in some cases data need to be processed through different steps and then data insights can be found. In order to do this processing,…
Read More
Spark

Spark

Technology
Apache Spark: Its fast cluster computing system. Ready to use & scalable cluster framework. It is available in different sets as per requirement – processing, streaming, SQL, graph etc. How to install: (Useful Links) http://spark.apache.org/docs/latest/ http://nishutayaltech.blogspot.in/2015/04/how-to-run-apache-spark-on-windows7-in.html OR 1. You can run it without installing as well - just needed jars for spark 2. You can add maven dependency <dependency> <groupId>spark</groupId> <artifactId>spark</artifactId> <version>....</version> </dependency> Example in Java: Aim - Process file and get longest line length Code: Dependencies : import org.apache.spark.api.java.*; import org.apache.spark.SparkConf; import org.apache.spark.api.java.function.Function; import org.apache.spark.api.java.function.Function2; Creating RDD: String testFile = "C://disk//filename"; SparkConf conf = new SparkConf().setAppName("Simple Application").setMaster("local[2]"); JavaSparkContext sc = new JavaSparkContext(conf); JavaRDD<String> testData = sc.textFile(testFile).cache(); //Process data and get maximum line length in variable num System.out.println(num); With inline functions:   int num = testData.map(new Function<String, Integer>() {public Integer call(String s)…
Read More
CPG Industry and Analytics

CPG Industry and Analytics

Analytics
CPG Industry CPG – consumer packaged goods industry is more oriented towards consumers, so we can also call it customer preference market. In CPG, companies have to concentrate more on consumer behavior. Customer preferences should be taken into consideration and anyone who can fulfill the needs will definitely lead the market. The consumer packaged goods industry is one of the largest industries which value in trillions. Currently, industry growth is steady for this sector and many companies are earning large profits. Many companies are earning multibillion dollar revenue and it will grow. CPG industry is comprised of different goods which need to be manufactured packaged and marketed to fulfill consumer needs e.g. Food and beverages, Clothing, Household Products etc. Current Practice: Company purchases raw material from providers, processes it through…
Read More