CS-702-D Big Data - Dec 2024 Question Paper

Under each question, How to answer lists the points an answer should cover, outlined by CampusPrep from the syllabus. Check the details against your textbook.

1. 7 Marks
   aList the components of Hadoop, explain its use.
   How to answer

   • List Hadoop core components: HDFS, YARN, MapReduce, Hadoop Common
   • Brief function of each component
   • Use/purpose: distributed storage and processing of Big Data
   • Example use-cases
2. 7 Marks
   bWhat are the V's of Big Data? Explain with examples.
   How to answer

   • Define V's of Big Data: Volume, Velocity, Variety, Veracity, Value etc.
   • Explain each V briefly
   • Give example for each V
   • Significance for Big Data systems
3. 7 Marks
   aExplain the required infrastructure for Big Data.
   How to answer

   • Define Big Data infrastructure need
   • Hardware: clusters, storage, networking
   • Software: Hadoop, NoSQL, virtualization/cloud
   • Scalability and fault tolerance aspects
4. 7 Marks
   bExplain concept of Map Reduce using an example.
   How to answer

   • Define MapReduce concept and phases: Map, Shuffle, Reduce
   • Explain with word-count or similar example
   • Role of key-value pairs
   • Diagram of data flow
5. 7 Marks
   aExplain in detail building blocks of Hadoop with neat sketch.
   How to answer

   • List building blocks: HDFS, YARN, MapReduce, Common, Pig, Hive, HBase etc.
   • Explain role of each block
   • Show layered architecture with neat sketch
   • Interaction between blocks
6. 7 Marks
   bDiscuss on the different types and formats of Map-reduce with an example each one.
   How to answer

   • Define MapReduce types/formats: input formats, output formats
   • Explain TextInputFormat, KeyValueInputFormat, SequenceFile etc.
   • Give example for each type
   • Use-case for each format
7. 7 Marks
   aDefine HDFS. Discuss the HDFS Architecture and HDFS Commands in brief.
   How to answer

   • Define HDFS and its features
   • Explain architecture: NameNode, DataNode, blocks, replication
   • List common HDFS shell commands with syntax
   • Read/write flow in brief
8. 7 Marks
   bExplain procedure to write user defined functions in Hive. https://www.rgpvonline.com
   How to answer

   • Define Hive UDF and its types: UDF, UDAF, UDTF
   • Steps: write Java class extending UDF, implement evaluate(), build jar
   • Steps: add jar and create temporary function in Hive
   • Example usage in Hive query
9. 7 Marks
   aWrite a word count program in Pig to count the occurrence of similar words in a file.
   How to answer

   • Load input file using LOAD statement
   • TOKENIZE and FLATTEN lines into words
   • GROUP by word and COUNT occurrences
   • STORE/DUMP result; Pig Latin script
10. 7 Marks
    bExplain working of Hive with proper steps and diagram.
    How to answer

    • Define Hive and its role over Hadoop/HDFS
    • Explain components: driver, compiler, metastore, execution engine
    • Steps of query execution from HiveQL to MapReduce
    • Neat diagram of Hive working
11. 7 Marks
    aWhat are the different Hive data types? Explain them briefly.
    How to answer

    • List primitive types: TINYINT, INT, BIGINT, FLOAT, DOUBLE, STRING etc.
    • List complex types: ARRAY, MAP, STRUCT, UNION
    • Brief description and example of each
    • Use in table schema definition
12. 7 Marks
    bWrite a short note on use of NoSQL database in industry.
    How to answer

    • Define NoSQL database
    • Industrial uses: social media, e-commerce, IoT, big data analytics
    • Examples: MongoDB, Cassandra, HBase
    • Benefits for industry: scalability, flexibility
13. 7 Marks
    aDiscuss various types of NoSQL databases with example.
    How to answer

    • List four types: key-value, document, column-family, graph
    • Explain each with characteristics
    • Give example DBMS for each: Redis, MongoDB, Cassandra, Neo4j
    • Comparison of use-cases
14. 7 Marks
    bDiscuss key characteristics and advantages of NoSQL database.
    How to answer

    • Define NoSQL key characteristics: schema-less, horizontal scaling, BASE
    • Explain advantages: high availability, flexibility, performance
    • Contrast with RDBMS briefly
    • Suitable application scenarios
15. 14 Marks
    Explain the following.

    1. i)Social Network as a graph
    2. ii)Social Network Mining
    3. iii)Recommender system
    How to answer

    • Social network as graph: nodes, edges, properties
    • Social network mining: community detection, link prediction
    • Recommender system: collaborative/content-based filtering
    • Examples for each concept