Documentos de Académico
Documentos de Profesional
Documentos de Cultura
Big Data
hanyalah buzzwords
Gartners
Hype Cycle
2014 - sekarang:
Fase
disillusionment
Big Data
Be Data Driven
Volume
Rule of thumb:
1 TB
atau
1 billion rows
atau
analyzing it doesnt
fit in one servers
memory
Variety
Text
Numbers
Geolocation
Time-series
Image
Audio
Video
Biometrics
Velocity
Batch
to
Stream
to
Real-time
Veracity
Accessible
Accurate
Coherent
Complete
Consistent
Defined
Relevant
Timely
Value
Both meanings:
Value = nilai, angka, ukuran
Value = nilai, manfaat, keutamaan
Where
are we at
now?
More data-driven
organization
covers lower levels
and invests more
heavily on the
upper levels
Data Quality
accessible
accurate
coherent
complete
consistent
defined
relevant
timely
Data Collection
Factor
Description
Priority
Urgency
High
Value
High
Cross-team
High
Ephemeral
High
Enrichment
Medium
Ease of (re)use
Medium
Historical availability
Medium
Workaround
Low
Quality
Low
Maintainability
Low
Usage
Low
Centralized
Decentralized
Hybrid
Consulting
Functional
Centralized vs Decentralized
Redundancy of domain knowledge (if one leaves, others still have knowledge)
Mindset / Culture
Ability
Tools
Data
People
Principles
Mindset / Culture
Ability
Tools
Ability
Math / Statistics / Machine Learning
Data Visualization
Programming
Data Engineering
Business Skills
Probability
Bayesian
Distributions
Statistical Tests
Simulation / Monte Carlo
Regressions
Linear
Logistic
Feature selection
Classification
Clustering
Outlier detection
menjelaskan apa
Exploratory:
Inferential:
Predictive:
Causal:
Mechanistic:
Ability Data
Visualization
Ability - Programming
Numerate
Systematic, detail-oriented
Curious, creative
Good communicator
Patient
Passion in data
Love to learn
Pragmatic, business-savvy
Mindset / Culture
Ability
Tools
Tools
Use correct data landscape for your use case
Batch? Streaming?
How much data? How fast?
Aggregate specific metrics? Data exploration?
Ad-hoc? Periodical?
Use visualization tools
Consider budget vs time investment
mattturck.com
insightdataengineering.com
Visualization Tools
Enterprise / Proprietary
Tableau
TIBCO Spotfire
Qlikview
TIBCO Jaspersoft (Enterprise Edition)
Periscopedata.com
RJMetrics.com CloudBI
Looker.com
What do we need?
The essence of all these
Most of what
youll need is BI
Data Science
exploring unknowns
vs
Analytics / Business Intelligence
specific metrics
Data Scientist = ?
Statistics > coders
Analytics
and/or
Business
Intelligence
To do for corporates
Track data - sebanyaknya sejak awal - Variety not necessarily Volume
Be Data Driven - bikin strategi dan ambil keputusan berdasarkan data
Fokus di kualitas Veracity & Value
But dont worry too much either
kebanyakan perusahaan belum bisa atau
belum melakukan
Penutup
ainunnajib@gmail.com
WA/Telegram +65 8113 1571