Competency Name:
Broad Definition:
Criteria
I Criteria for defining
proficiency vis-à-vis
knowledge & skills
1.Precondition
[ Expressed as a prerequisite - • Programming - Core Java
in terms of academic
qualification AND / OR
industry experience
(whichever is applicable) AND
/ OR relevant knowledge in
any other competency
TCS Confidential
BigData and Hadoop Ecosystems
This competency refers to the ability of the associate to work on Bigdata and Hadoop Ecosystem. It covers Mapreduce, HDFS,
Pig latin, Hive, Hbase & YARN, Apache Avro, DataFu, Apache Flume, Fuse-DFS, Apache HBase, Apache Hive, Hue, Apache
Mahout, Apache Oozie, Apache Sqoop, Apache Whirr, and Apache ZooKeeper. This competency measures skill levels of an
associate for applying Hadoop components to the Hadoop based solutions.
E0 E1 E2 E3
Should have knowledge on: Should satisfy all the Should satisfy all the conditions of Should satisfy all the
conditions of the previous the previous proficiency level conditions of the previous
• Conceptual understanding of proficiency level proficiency level
Linux and basic commands Should have Linux
(Linux OS E0) knowledge
2. Knowledge Should have :
[Expressed as Area of • High level understanding of
knowledge and not skill, Concepts like Distributed File
includes knowledge of Systems, Distributed
process, methodologies, Processing, Streaming &
concepts and tools.] Schema on Read
• Conceptual knowledge of
map reduce framework and its
use in hadoop eco-system
solutions like Pig and Hive.
• Basic understanding of
solutions which can be offered
on Hadoop Platform using its
core attributes i.e. Adhoc-
Querying using hive,
Algrothims and patterns using
Map Reduce, High avaialbility
options for data and
computing etc.
TCS Confidential
Should have:
• knowledge on various
ecosystem components like
Map/Reduce, Hive, Pig and
Hue using one Distribution
e.g. Cloudera, Apache
• Ability to conduct PoC by
leveraging hadoop
ecossystems like hive, pig,
spark, spark streaming,
kafka, flume etc.
• Knowledge on writing unit
and integration test cases
for hadoop applications
using map-reduce and
spark programming
paradigm. Ability to validate
/ verify SQL procedures on
Hive.
• knowledge on SQL
concepts and querying and
comparision to what
abilities are available on
hive..
Should possess: Should possess:
• Advanced Knowledge on the • Design & Architecture
integration of various components
aspects of atleast one
of various Hadoop ecosystem distribution in High Availability
components like hive, pig, spark,
cluster environment
spark streaming, kafka, flume and
• Performance Tuning of
its use cases. Hadoop ecosystem using
atleast one distribution
• Performance Tuning and best •Cluster sizing with knowledge
practices for map/reduce jobs, of hardware architectures with
hive queries, Pig and spark respect to failover and high
programming paradigm in atleast availability.
one distribution • Ability to compare scenarios
for Hadoop implementation and
suggest the right fit
components for given customer
situation
• Ability to compare Hadoop
distribution for customer
situation and knowledge about
more than 1 distribution
• Ability to consult customer on
Hadoop implementation
strategy & the right product
fitment
Contd. • Knowledge of NoSQL, and
ability to create and defend
solution based on the kind of
use cases in business
porblem. Indepth knowledge of
One of various type of NoSQLs
avaialble i.e. Cassandra,
MongoDB etc. Should be able
to highlight solution around
consistency and availability.

3. Experience
[Expressed as duration in
months / years wrt exposure,
including breadth & the depth
of assignments; also beyond
project experience]

TCS Confidential
3.1 Type of project
experience
[Includes 'type' in the form of
implementation, end-to-end
project, support, roll outs,
upgrades, professional
services, consulting
engagements AND / OR the
Number of projects AND / OR
Time spent on the project ( for
eg., 3 consulting projects of
minimum 6 months duration ;
1 roll out project of at least 18
months]
TCS Confidential
Should have:
• 0-6 months hands-on
experience on :
•• Mapreduce, HDFS, Pig
latin, Hive, Hbase & YARN
using atleast one distribution pseudo distributed mode
•• Apache Avro, DataFu,
Apache Flume, Fuse-DFS,
Apache HBase, Apache Hive, RDBMS concepts or Linux
Hue, Apache Mahout,
Apache Oozie, Apache
Sqoop, Apache Whirr, and
Apache ZooKeeper through
classroom hands on
excercises and PoCs
Should have:
•Minimum 6 months hands-
on experience in atleast
one distribution
AND
•Should have experience in
setup
AND
• Working experience in
scripting (Upto 6 months)
• Working experience in
Java /BI or similar projects
in dev, design &
architecture (1 years+)
OR
•Working experience in
Hadoop (6 months to 1
Year of experience, atleast
one project OR 2-3 PoCs)
Should have:
•Working experience in atleast
one distribution (Upto 1 yr of
experience, atleast two projects
AND 2-3 PoCs)
•Should have hands experience in
performance tuning of atleast 1
distribution
AND
• Working experience in RDBMS
concepts or Linux scripting (6
months +)
• Working experience in Java/BI
or similar projects in dev, design
& architecture (3 years+)
Should have:
•Design and development
experience in atleast one
distribution (2 Year+ of
experience, atleast 3 projects
AND 2-3 PoCs)
AND
• Working experience in Java/
BI or similar projects in dev,
design & architecture (5
years+)
3.2 Beyond project
development experience
[Includes
[1) Solutioning of proposals
2) Reviews done
3) No. of contributions made
to trainings/training material]
4. Asset Creation
[Expressed as any reusable
and deployable assets
created in the knowledge
management system of the
organization]
4.1 Process frameworks
defined
[Articulated as the process
improvement designed OR a
new process framework
designed]
TCS Confidential
N/A N/A Should have provided estimates Should have provided
for Siebel UCM Application estimates for Siebel UCM
Configuration in MDM solution for Solution for 2 proposal
atleast 1 proposal OR
OR Should have contributed 10
Should have contributed 5 person- person-days of effort in a year
days of effort in a year in ISU Pre- in ISU Pre-sales involving
sales involving Siebel UCM Siebel UCM (Solution/
(Solution/ estimates) estimates)
OR OR
Should have done 1 Siebel Should have done 2 Siebel
CRM/UCM Project Technical UCM Project Technical Audit
Audit OR 1 Siebel CRM OR 1 Siebel UCM Review
Application Configuration OR
Technical Review Should have conducted 1
OR training on Siebel UCM
Should have conducted 1 training Application
on Siebel CRM Application Configuration(Siebel Essential
Configuration(Siebel Essential Training) for min 2 working
Training) for min 5 working days days
OR OR
Should have reviewed at least 2 Should have reviewed at least
implementation methodologies / 3 implementation
Process Artifacts / Knowmax methodologies / Process
Assets / Mighty Reusable (for Artifacts / Knowmax Assets /
Siebel UCM) Mighty Reusable (for Siebel
UCM)
N/A N/A N/A • Built a solution framework to
improve the productivitiy in
Hadoop projects
4.2 Tool creation
[Expressed as a system or
function tool designed OR
created towards improving
business delivery / learning]
4.3 Reusable & deployable
assets created
[Expressed as reusable and
deployable assets created
(like those in Mighty &
Knowmax]
OR
No. of training material N/A
created
[Expressed as the number of
relevant training material
created towards development
of a particular body of
knowledge or skill]
5. Industry contribution
[Expressed as the
contributions made to the
industry.This criteria should
be measured by mechanisms
for eg: TCS GEMS]
TCS Confidential
N/A N/A Should have:
• Contribution to least 1
deployable tool in any focused
ecosystem component (e.g. code
review tool)
N/A N/A Should have:
• Contributed to creating at least 1
asset to help big data projects
(e.g. scripts, programs)
N/A Should have assisted in
creating/reviewing at least 1
training material / KSS
presentation pertaining to Siebel
UCM Application Configuration
Processes(per year)
Should have:
• Mentored creation of at least
1 deployable tool in any
focused ecosystem component
(e.g. code review tool)
Should have:
• Mentored creation of at least
2 assets to help big Data
projects (e.g. Best practices,
scripts, programs, documents)
Should have created/updated
at least 1 training material /
KSS presentation pertaining to
Siebel UCM Processes
5.1 Recognized by Peers
[Expressed as the recognition
given by the peer community
and should be measured by
appropriate mechanism such
as TCS GEMS]
AND/OR
Recognized by a Parent
Body
[Expressed as the
contribution recognized by a
renowned and recognized
parent body]
AND/OR
Invited as Speakers
[Expressed as recognition
from an external body when it
extends an invitation to the
speaker to address a
recognized forum]
II Assessment / Evaluation
Methodology vis-à-vis
Proficiency Level
TCS Confidential
N/A • Should have responded to • Should have been recognized as
queries in Knowmax an SME for technical expertise
discussion forum and (e.g. Customer appreciation for
should be an active design & dev, Supervisor
member in communities in confirmation that associate can
Knowmax lead the team to design the
solution)
• Should be an active member in
the discussion forums in
Knowmax and responding to
queries
Submitted patches to
problems/issues in the opern
source forums
N/A N/A N/A
N/A N/A N/A
• Should have been recognized
as an SME for technical
expertise (e.g. Customer
appreciation for design &
architecture, Paper
presentation in TACTICS,
Case study presentation in
ABIM, Solution Quality during
the consulting engagements or
proposals)
• Should be active member in
Hadoop communities
• Should be an active member
in the discussion forums in
Knowmax and responding to
queries
Should have got certification
from hadoop distributer like
cloudera, IBM etc
OR
Should have published white
papers in Big data space in
recognized forums
OR
Submitted patches to problems
in the opern source forums
Presented case study or
solution in external Hadoop /
Big Data conferences like
Hadoop Summit
1. Certification As defined in the LO. As defined in the LO. As defined in the LO. As defined in the LO.
[Expressed as achievement of
external programs - certifying
a part of the proficiency level,
Achievement of internal
programs - internal trainings
attended]

2. Evaluation Test Should have completed the Should have completed the Should have completed the Should have completed the
[Expressed as a certification following: following following following
the individual has to achieve
towards the said proficiency Self assessment and Self assessment Self assessment Self assessment
level. (for eg.,Type of tests for Learning object. Learning object Learning object and Learning object
each proficiency should be Supervisor Assessment Supervisor Assessment
defined-like for E0 level it will SME Assessment
be only self assessment, for
E1 it should be panel review
etc)]

Version History
Project Details:
Unit: Analytics, Big Data and Information Management Services (ABIMS), DESS
Parent Project-
Project Owner/GL- Name & employee No : Kamlesh Mhashilkar, Pracitce Head, ABIMS

Amendment History:
Version Defined By Approved By - Role & Facilitated By Date
Group
Version 1 Vijay Garg (358943) Kamlesh Mhashilkar, Sulabha Manjrekar (384715) 29th April,
Manoj Mathai (175646) Pracitce Head, ABIMS Learning and Development 2015
G Ramsubbareddy (776037)
Rashmi Paranjape (325653)

TCS Confidential