Hadoop : An interesting Case Study for Java Professionals

Case Study

The Hadoop cold storage contains data that is infrequently accessed. By using Amazon EC2, the company is able “to absorb large data volumes with fluctuating demands” and then, as needed, transfers data sets to Amazon Elastic MapReduce. He offered some general observations about the Hadoop platform… “Hadoop Distributed File System is the sexy part of the Apache Hadoop project. It is open-source and allows the problem solving qualities of MapReduce to really shine. It is a brilliantly simple framework that works well.”

Architecture

Company B processes 5.5 terabytes or 36 billion rows of click stream data every day from digital media, site behavior, social media, and offline media. In media speak, that’s about 400 billion media impressions per year. The daily process uses Amazon Elastic MapReduce (EMR) to cleanse and aggregate the clickstream data into transactional cookie-level (or session-level) data, which passes to Aster Database for advanced analysis. In addition, the large data sets are retained in Amazon S3 cold storage for future analysis. The transactional data is partitioned among their clients. Clients have their separate custom data marts so that the client data is not co-mingled. The client data is optimized and structured as custom OLAP cubes for use by our internal client teams. Reporting to the clients about digital marketing performance is performed from these cubes.

Company B built a data mart customized to the unique business requirements for each client. Access to the client data mart is primarily by our internal teams. Though there is high-level reporting directly to clients so that they can understand why we decided on certain advertising optimizations. Clients need to know why Company B has moved their funds from one advertising channel to another.

Thank You

Saurav Kumar Sinha

Why should one go for SAP BW Training ?

The reporting, analysis, and interpretation of business data is of central importance to a company in guaranteeing its competitive edge, optimizing processes, and enabling it to react quickly and in line with the market. As a core component of SAP Net Weaver, the SAP Business Information Warehouse (SAP BW) provides data warehousing functionality, a business intelligence platform, and a suite of business intelligence tools that enable businesses to attain these goals. Relevant business information from productive SAP applications and all external data sources can be integrated, transformed, and consolidated in SAP BW with the toolset provided. SAP BW provides flexible reporting and analysis tools to support you in evaluating and interpreting data, as well as facilitating its distribution. Businesses are able to make well-founded decisions and determine target-orientated activities on the basis of this analysis.

Module of SAP BW Training 

Training Modules 

Standard Course Content in SAP BW 

·         SAP DATA Warehousing.

·         Introduction to Data warehousing

·         Father of Data warehouse

·         Definition of Data Warehousing

·         Key functions of Data Warehousing

·         Applications & Types of SAP

·         Over view of SAP R/3 Types of Applications

·         OLTP

·         OLAP

·         R/3 Architectures

·         Landscape of SAP

·         Transportation

·         Package

·         Request no

·         Return codes

·         Types of Data

·         Master data

·         Transaction data

·         Master Data

·         Attribute data

·         Text data

·         Hierarchy data

·         Transaction data

·         Header data

·         Item data

·         Scheduline data

·         Star Scheme Concepts

·         Classical star schema.(DW)

·         Extended star schema.(BW)

SAP BW/BI Introduction.

Introduction to SAP BW/BI

History of SAP BW/BI

Necessity of SAP BW/BI

SAP BW/BI Architecture

Source System & Target System

Source system connections

Data Modeling, Loading and Extraction

Data Reporting

SAP BW DATA Modeling

Info area

Info objects Catalog

Info objects

Info source

Direct update

Flexible update

Data source

Source system

Application component

Transfer rules

Transfer structure

Communication structure

Info providers

Data targets

Info cubes

Standard Info Cube

Real-Time Info Cube

ODS

DSO

Standard DSO

DSO for Direct Update

For details on the course AND ONLINE TRAINING please get in touch with me over the mail : mrigank.sks@gmail.com

Saurav Kumar Sinha

Why I didn't vote in 2014 General Elections

All of India is geared up to vote for General Elections 2014. Some are voting for change some are voting for a better India some are voting because they always do to ensure they have done all what a loyal citizen should do. Electronic Media, Print Media , coffee houses , pubs , dinning table .every where we are discussing about the election and why should one vote and to whom to vote. I have decided not to vote. When I talk about traditional political party, my conscience doesn't allow me to vote for them. I know NaMo has a huge supporter base but when it comes to democracy where we have decentralization to an extent , we should vote comparing our local candidates and not in the name of PM candidate. When it comes to transparency and corruption all parties are same. Definitely there is a wave to vote, to vote to individuals who found this " change " as an agenda to gain votes and to enter the parliament. And being a Hindu i know how BJP has used Ram over the years to get the votes. Even politics over Banaras is not correct, In my opinion politics and religion should not be mixed, we have seen in past how Babari Masjid led to many small and big riots across India. Why I will not vote for congress is known to every educated citizen of this country even though Nandan Nilekani is standing from the place I live and I see a hope in him.

I was very optimistic about the change that AAP might have brought after coming into politics. The four pillars

1. Transparency
2. Internal Lokpal
   
   
3. Decentralization 
4. Swaraj 

were the reason that I joined the party as a volunteer back in Dec 2012. An year into the party and Delhi win was a game changer into Indian politics. People who only talked about alternate politics since JP movement got a platform to work together. But party was unable to deploy the four pillers atleast inside the party also. I was not of the opinion that party should fight for 2014 elections but what made top leaders to fight I don't know. This eagerness to win few seats in elections lead to disintegration of party in many states as well as on national level.

I saw this clause on National AAP Website

Please note that it is MANDATORY to get the signatures of 100 proposers from EACH assembly constituency in order to complete your form. (e.g. if a Lok Sabha seat has 8 Assembly Constituencies then you need signatures & details of 800 proposers to complete your form)

Also few from decentralization that we have promised and taken funds in the name of but were not able to showcase in our own party also 

Today all big and small decisions that affect the nation are taken by a few select members of this body of governance. Once the ruling party comes to power, a few top leaders at the head of the party and a handful of influential corporate honchos decide all policies. Where is the voice of the common man in this decision making process? 

A part of Vision Document

We want to create a system where the political leaders we elect and place in the Parliament are directly responsible to the voters who elected them. Our party's vision is to realise e dream of SWARAJ

From the page ( How we are different )

Point Number 5

No one would need to buy an election ticket in our party. Candidates contesting elections from an area will be selected by the people of that area

Point Number 8 ( I hope we'll come up till someone replies to this mail )

Every member of the Aam Aadmi party will have to follow a strict internal code of conduct or internal Lokpal. This independent body will be headed by 3 jurists and other eminent personalities with impeccable public records

A question that we need to answer that are working on the same strength or pillars for which we were able to create a revolution

AAP Karnataka Team which I was a part of has lead the revolution die and have betrayed donors volunteers and people. 

Few Question to AAP Team in Karnataka 

1. Was transparency in candidate selection process followed ?
2. If 800 signatures were not required why few had to and for others it was not 
3. How did this search committee came into existence where as the essence of the party comes from to elect people from common consensuses ?
4. Was signatures taken from local volunteers on candidature 
5. How did the number of SPC member kept on increasing from 8 to 20 to 32 and still increasing and decreasing ? ( It has to be elected or selected from a group of volunteers and not few individuals )
6. Why state preparatory committee has individuals only from Bangalore ? Do we think All politicians and leaders of Karnataka live in Bangalore
7.  A resolution that was taken in SPC meeting on 27th Sep that "Every 3 months, SPC would be convened outside Bangalore in different districts on rotational basis." how many meetings of the state has been conducted outside Bangalore.
8. After Becoming State coordinator what are the districts our leader has traveled before Delhi Election result.
9. How many conventions were conducted till February 2014 and why didn't we focus on elected bodies and have run the preparatory body till the edge of elections ? Why we stopped electing formal bodies .

There are many more questions on the inefficiency of the team. Now Why I am doing it today.

Started to work on ground for Party with social initiatives since June 2013. Took responsibility of Bommanahalli AC constituency ( Formal elections have been done with one of the best teams working across Karnataka So Few Top Notch Executives cant say I left work in Between), then I took responsibility of AAP South Bangalore ( MP Assembly Seat )

Was selected in SPC and then working committee through a voting ( Hand raise process in a meeting )

I have been raising this questions and tried to build from within since July 2013 , Argued and discussed a lot in SPC/ Working committee meetings but the team ( Few Decision makers ) has always neglected questions and it was easy for a bunch of Individuals to sideline most junior of them all.

I didn't want my self to be confined and typecast into one category. Whole of India is busy in forming his or her group based on party which you support. A new way to divide and rule.

When we talk about India and when every party is fighting for a better India why a lot of fiction verbally as well as physically. So I decided not to vote. Let history decide weather my decision we right or wrong.