Transcript: Big Data Too expensive to leverage using traditional data mining tools Ever growing datasets The plan 3) Make customer aware of business case Hadoop 2) Training Data Mining Skills Amazon, cloud... Scalable Architecture Cassandra Demand 4) Offer skills and consulting to customer 1) How big is customer demand? Mahout etc...? Availability of vertically scalable commodity solutions makes Big Data an affordable data mining alternative Tools
Transcript: Thought by Google, maintained by Yahoo, Twitter, Facebook and more big players 'Hadoop' cluster online with limited hardware Readers : Top viewers (cheater detection) https://wiki.dailymotion.com/display/Pdt/Specs+-+Advanced+Statistics+Revamp Domain : Top domains (views on domain) Stats for internal / external use (business intelligence, partners requests...) Test interface online with limited scope ('10.000 most popular', no spam filter) Enhanced audience profiling http://stage-07.dailymotion.com/test/top Big Data : Introduction Limited scope Coming next Designed for swift processing of large datasets Very limited data availability What is it ? Coming next What will this bring to the table ? Advanced stats revamp Our situation Low request time, large scale availability Clean interface Very high request processing time Cutting edge data mining technology Multi-purpose cluster : https://wiki.dailymotion.com/display/Pdt/Specs+%3A+Big+Data+PoC Country : Top countries (viewers) Behavior-based features (Related videos, Subscriptions recos...) Videos : Most viewed videos on the platform Channels : Most viewed channels Outdated, unreliable data mining tools Users : Most viewed users Available to everybody without restrictions and short response time Current achievements Questi ns ? Linear scalability : 10% more hardware = 10% more computing power Insights Filters definition
Transcript: Questions? ; ) development of effective drugs improving the system of treatment of certain diseases DEVELOPMENT: - 30 BILION PIECES OF CONTENT WERE ADDED BY 600 MLN USERS TO FACEBOOK THIS PAST MONTH - MORE THAN 2 MLN VIDEOS WAS WATCHED ON YOUTUBE... YESTERDAY - ZYNGA PROCESSES 1 PETABYTE OF CONTENT FOR PLAYERS EVERY DAY VOLUME: not too much entities have access to our data - storage is very expensive our decision think about profits it is said, Big Data is a threat to freedom data are accumulated by every institution but not use data are not stolen, they are received legally Big Data is not used for surveillance, but rather to analyze and visualize data precised targeting of advertising messages increased efficiency less junk ads on the Internet Public institution: Medicine: V BIG DATA Thank you for attention. olume better occurrence forecast effective accomplishment of the fundamental duties Marketing: Big Data - Surveilance Instrument Development in many sciences Trust or not to trust? Key questions: ariety elocity
Transcript: WPF Templating Styles Property Triggers Data Triggers Event Triggers Templates Refactoring It is better practice to store templates and other large resources as seperate resource dictionaries. As an example, we would store our custom Listbox in a resource dictionary called CustomListBox.xaml and import it in our App when we want to instantiate that custom control. Control Templates Apply a set of property values to an element Change the appearance of any style-related (read: asthetic) property Used when you need to have a common set of property values on multiple elements Default Style element is FrameworkElement. Specify TargetType to style other elements IsMouseOver = true Visual tree takes the hierarchical tree and expands its elements into all visual components. Control templates are XAML "recipe" for a control. We can copy the contents of a control template and modify it to "reskin" a core WPF control. Templates vs. Styles Although you can find the templates for WPF core controls in MSDN documentation, easiest way is to use Expression Blend. - Add a control - Right Click on control -> Edit Template Templates used for hierarchical data such as TreeViewItem and MenuItem A chunk of XAML markup that defines how a bound data object should be displayed. Visual Tree Hierarchical Data Templates Styles EventTriggers are hooked up to routed events and generally spark an animation related action on the element to which the style applies. Used to bind to properties of the control to which you are applying the template. Useful when the property is not specific to the aspects you are customizing. Event Triggers Item Panel Templates Templates used to override how objects are layed out in a Panel (or any class derived from Panel). DataTriggers work much like PropertyTriggers but operate on any object property instead of just WPF dependency Property. Property Triggers Logical Tree vs. Visual Tree Styles are used to adjust properties of an element. Templates can replace the entire visual tree of an element. Ex. Use template to replace the background of a button with an ellipse or path object. Data Triggers Styles can be inherited from other styles. Simply use the property "BasedOn" in the Style element. Data Templates Logical tree is a representative tree that describes the heirarchical composition of a WPF application. Style Inheritance IsMouseOver = false Define a list of setters that are activated when specific condition is met. Template Bindings Triggers Logical Tree
Transcript: That's a 4,300% increase from the data storage of 2013. 1,000 petabytes = 1 exabyte 1,000 gigabytes = 1 terabyte In Conclusion: By 2020, experts predict there will be almost 40 zettabytes of data stored by people around the world... How Big is it? Understanding Data If we DO learn how to make sense of it, we're going to be a whole lot better off. Data analytics are getting better at modelling consumer trends and effectively bringing you what you want 2.5 exobytes of what? Big Data gives the customer what they want 1,000 terabytes = 1 petabyte It took about 1 petabyte of storage to create the 3D CGI effects in Avatar And its only going to get bigger. It might be creepy, but it's helping you False Discoveries Businesses are finding new unexpected patterns in data that can help to solve complex social problems BIG DATA Connecting Data is better than collecting data A Word document containing all the words ever spoken by human beings would require about 5 exobytes New data analysis patterns are helping to spot disease outbreaks before they spread Daniel Crane If we don't learn how to make sense of it, we're screwed. However, because there is so much data in "Big data", sometimes patterns and connections are merely coincidence. Based on Jim Harvey's speech structures 1 Terabyte holds the equivalent of about 200 DVDs To put that into perspective... Everyday, 2.5 exobytes of data is created and uploaded to the Internet. What is an exobyte? Q: How big is big data? A: It's F*ing huge.
Transcript: What is it? 600M to be installed by 2016 4.1 B text messages per day in the US What happens if we try to use traditional tools? (imagine being able to plan your next move with the help of insights from every move of every chess game ever played!) transactional systems Operational gymnastics required to manage Database Responsibilities & Functions What can we use Big Data for? unmanageable transaction and log files Products Trillions already deployed Optimal Path e-bill pay Using ALL the data to support decision making Big Data Infrastructure (highly parallel) From the beginning of time until 2003, about 5 billion gigabytes of data have been created. Product (and other business) Decisions (virtual collaboration) vs Executive calls text transactional servers transactional systems ytic Trillions already deployed! (approx one typewritten page of information) modeling Graphs (Execution level) Estimates are that Social Media has created a situation where there are only 8 degrees of separation between every person on earth! Mgr Source and Store ar Click to chat (artifical ceiling) Transacational servers Velocity work orders One Step Ahead White, Tom (10 May 2012). Hadoop: The Definitive Guide. O'Reilly Media. p. 3. ISBN 978-1-4493-3877-0. work orders I get it smart meters Transactions Transactions Improving Production Quality Fast Follower Possible pitfalls of not using Big Data Trouble Tickets Blogs (business transactions and functions) Billions of smart tags, sensors, meters & other transmitters Identifying Waste Fields Accts Payable Equipment 2.5 quintillion bytes per day Fast Follower Executive Market Leader Database meltdown Delivery Disconnected Targets Data Driven Traditional Analysis Cloud Data Discipline Greater Where does Big Data come from? Big Data Lots of Data Enterprise Search Ingestion Process Blogs Mashup Engine Analyze & Classify (All available work order data too voluminous to be useful) Capturing Processing Designing Developing Managing Maintaining Reports Executive Other possible uses for Big Data (Lots of data) Dominator Delivery Operations Strategic Thinking & Planning Data Sensor Data Trend Setter Servers Data Cloud volume Disconnected Functions and Departments 340 M "tweets" per day Hadoop Integration & Transformation Cloud Receivables (and growing) Data Greater only transactional systems Human Resources EXAMPLE from vs Procurement Volumes Sep 2012 Unleashing the Power of Big Data Data Driven Organization Social Media Feeds Market Leader FaceBook Posts Employees Sources Locations from Cameras Receivables why? (formats, structures and protocols that don't work with traditional tools) Engineering M Inventory Management weather Billions of Digital devices, applications & "conversations" Execution ( A few examples ) Data Driven Decisions Management Mgr Than ever before!! Analytic Collaboration data data data data data data data data Super human effort required Surfaces Indicators Trends Patterns ... ... Relationships Direction (check prices, availability, consumption data, coupons, etc) Customer Calls, on-line ratings, automated interactions, etc. Employees Sensors (Can't take advantage of all the available data) text (artifical groups) Relational Databases Reporting BIG DATA streams BIG DATA "90% of all the data in the world was created in the last two years!" Steady Eddie reviews - Strategy A LOTS of DATA ctional Control Systems Traditional Data analysis tools What is Big Data? Software and hardware & software log files transparency Accts Payable Connected Customer Driven why? visualization servers Distinguising Signals from Noise work orders Mgr What makes BIG DATA challenging? (Lots of data) Cont BIG DATA vs. Planning ket Trend Setter Leap Frogger Data Hundreds of systems and databases silos of data trouble tickets Management Food Safety Where does BIG DATA come from? Mostly tactical thinking & planning Processing RFID Secu The tools can handle the data but . . . . data data data data data data data data transactional servers Customer Care Advisor System Strategy Development (but little actionable intelligence) LOTS of DATA Modelling Forecasting Predictions Trends Profiling Fraud Detection Software Quality Able to use complex analysis to Visualize Possibilities Anal Focus groups, surveys, contests, promotions, campaigns, etc. User activity logs (arriving too fast to handle with traditional tools) - IBM website visbility Understanding Consumer Preferences (high level) ory Content Classification Store (Executive) Blogs Data Mining and Federated Searches Relational Databases (too large to handle with traditional tools) Big Data means different things at different levels of the organization text Data smudging, blurring & leaning Planning "1 of 3 business leaders do not trust the information they use to make decisions" So what? Financials ar Traditional Tools and Databases more (bars too small) Security & Governance No data discipline Mem Where does it come from? EXAMPLE Inventory air traffic
Transcript: Applications for Big Data Analytics wikipedia Cheaper Scales to Petabytes or more Faster Parallel data processing Better Suited for particular types of BIG data problems "BIG DATA" is similar to "small data".... John Chacko Increase of storage capacities Increase of processing power Availability of data What is Hadoop? BIG DATA is everywhere Why Big Data? HADOOP to the Rescue.. What is BIG DATA ?? Hadoop is an Apache top-level project Based on work from Google GFS + MapReduce + BigTable Doug Cutting led the Hadoop project. Named after his son's toy elephant. MapReduce Job logical view Low-Latency data access Lots of small files Multiple writers, arbitrary file modifications Hadoop layered architecture Homeland Security HDFS HDFS is not good fit for.. Smarter Healthcare How big really is "BIG DATA"? What is Hadoop? Multi-channel sales BIG DATA Highly scalable Performs a sequence of transformations on key value pairs 'BIGGER' "Every day we create 2.5 quintillion bytes of data; 90% of the data in the world today has been created in the last two years alone" 4 V‘s of Big Data Data Storage(HDFS) Runs on Commodity hardware Horizontally Scalable Fault Tolerant Processing(MapReduce) Parallelized Processing(Scalable) Other Tools / Frameworks Data Access - Hbase, Hive, Pig, Mahout Tools - Hue, Sqoop Monitoring - Greenplum, cloudera Hadoop is a set of Apache Frameworks and more... HDFS is a file system designed for storing very large files with streaming data access patterns, running clusters on commodity hardware. Key enablers of appearance and growth of Big Data.. …but having data bigger it requires different approaches... Why Use HADOOP? By 2015 4.4 million IT jobs in Big Data ; 1.9 million is in US itself - Gartner Search Quality http://en.wikipedia.org/wiki/Apache_Hadoop http://en.wikipedia.org/wiki/MapReduce http://www-01.ibm.com/software/in/data/bigdata/ http://hadoop.apache.org/docs/stable1/hdfs_design.html Volume Fraud and Risk REDUCE Aggregate result from map phase (K2,list(V2)) -> list(K3,V3) Trading Analytics Traffic Control Market Size Veracity Example: Word Count Variety MapReduce is a programming model for distribute computing. Executed in 3 stages "Flexible and available architecture for large scale computation and data processing on a network of commodity hardware." Examining large amount of data Appropriate information Identification of hidden patterns, unknown correlations Competitive advantage Better business decisions Effective marketing, customer satisfaction, increased revenue Map-Reduce concept Telecom "Apache Hadoop is an open-source software framework for storage and large scale processing of data-sets on clusters of commodity hardware." - wiki Velocity but a lot.. Big Data Analytics Technologies Highly Fault tolerant High Throughut Suitable for applications with large data sets Can be build out of commodity hardware Source: Wikibon Taming Big Data The Next Frontier for Innovation, Competition and Productivity Techniques Tools and Architecture "BIG DATA is the term for a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications." MAP Independent Record Transformation (K1,V1) -> list(K2,V2) Finance References Big Data Analytics NoSQL : non-relational or at least non-SQL database solutions such as HBase (also a part of the Hadoop ecosystem), Cassandra, MongoDB, CouchDB, and many others. Hadoop : Apache Hadoop is an open-source software framework BIG DATA is ANY attribute that challenges the CONSTRAINTS of a SYSTEMS CAPABILITY or BUSINESS NEED THANK YOU Name Node master of the system maintains and manages the blocks which are present on the datanodes Data Nodes slaves deployed on each machine and provide the actual storage. responsible for serving read write requests for the clients Manufacturing
Transcript: Example of a Jeopardy Template By: Laken Feeser and Rachel Chapman When creating without a template... http://www.edtechnetwork.com/powerpoint.html https://www.thebalance.com/free-family-feud-powerpoint-templates-1358184 Example of a Deal or No Deal Template PowerPoint Game Templates There are free templates for games such as jeopardy, wheel of fortune, and cash cab that can be downloaded online. However, some templates may cost more money depending on the complexity of the game. Classroom Games that Make Test Review and Memorization Fun! (n.d.). Retrieved February 17, 2017, from http://people.uncw.edu/ertzbergerj/msgames.htm Fisher, S. (n.d.). Customize a PowerPoint Game for Your Class with These Free Templates. Retrieved February 17, 2017, from https://www.thebalance.com/free-powerpoint-games-for-teachers-1358169 1. Users will begin with a lot of slides all with the same basic graphic design. 2. The, decide and create a series of questions that are to be asked during the game. 3. By hyper linking certain answers to different slides, the game jumps from slide to slide while playing the game. 4. This kind of setup is normally seen as a simple quiz show game. Example of a Wheel of Fortune Template https://www.teacherspayteachers.com/Product/Wheel-of-Riches-PowerPoint-Template-Plays-Just-Like-Wheel-of-Fortune-383606 Games can be made in order to make a fun and easy way to learn. Popular game templates include: Family Feud Millionaire Jeopardy and other quiz shows. http://www.free-power-point-templates.com/deal-powerpoint-template/ Quick video on template "Millionaire" PowerPoint Games Some games are easier to make compared to others If users are unsure whether or not downloading certain templates is safe, you can actually make your own game by just simply using PowerPoint. add logo here References Example of a Family Feud Template PowerPoint Games are a great way to introduce new concepts and ideas You can create a fun, competitive atmosphere with the use of different templates You can change and rearrange information to correlate with the topic or idea being discussed. Great with students, workers, family, etc. For example: With games like Jeopardy and Family Feud, players can pick practically any answers. The person who is running the game will have to have all of the answers in order to determine if players are correct or not. However, with a game like Who Wants to be a Millionaire, the players only have a choice between answers, A, B, C, or D. Therefore, when the player decides their answer, the person running the game clicks it, and the game will tell them whether they are right or wrong.
Description: Add some color to your quarterly business review with this vibrant business presentation template. The bold visuals in this business template will make your next QBR a memorable one.
Description: Storytelling is at the heart of great service. Use this stunning, customizable business presentation template to highlight employees who do exceptional work or position your customers as the heroes of your business.
Description: The sky’s the limit. Boost your new sales initiative into orbit with an engaging and compelling SKO presentation. This template features a effective sales kickoff theme that makes it easy to be engaging. Like all Prezi SKO templates, it’s fully customizable with your own information.
Description: Catch the eye and engage the imagination with this cool-looking Prezi proposal template. The bold, bright design and highly dynamic theme all but guarantee success for your next sales or marketing proposal. All Prezi presentation templates are easily customized.
Now you can make any subject more engaging and memorable