Foundational Concepts: Data, Information & Limitations of File Processing Systems
Before the advent of modern computer databases, organizations relied on physical paper ledgers, filing cabinets, and rudimentary computer file systems to track transactions. As institutions grew from handling hundreds of records to millions, these traditional systems collapsed under the weight of inefficiency, duplication, and human error. To understand why modern databases are essential, we must first examine the nature of data itself and dissect the fatal flaws of early file processing systems.
1. The Information Hierarchy: Data, Information & Knowledge
- Data (कच्चे आंकड़े / Raw Facts): Data refers to unorganized, uninterpreted facts, figures, symbols, numbers, or observations gathered without immediate context. On its own, raw data carries no definitive meaning or utility. For example, the standalone numbers
85, 92, 78or the isolated string"Patna"are pure data; we cannot tell whether they represent student marks, product prices, room temperatures, or city populations. - Information (संसाधित सूचना / Processed Data): When raw data is systematically collected, structured, processed, and presented in a meaningful context, it becomes Information. For example, if we state: "Ananya Kumari of Class 8, Roll No. 12, residing in Patna, scored 85 in Mathematics, 92 in Science, and 78 in English, obtaining a First Division," the raw numbers are transformed into clear, actionable information.
- Knowledge (ज्ञान / Actionable Insight): Knowledge is the synthesis of information, experience, and logical reasoning that enables informed decision-making. For example, analyzing school-wide examination information over five years to discover that students need specialized laboratory coaching in Science represents knowledge.
2. The Era of Traditional File Processing Systems
Prior to modern Database Management Systems, computer systems stored data using Traditional File Processing Systems (TFPS). In this approach, each department in an institution developed its own isolated computer programs and maintained its own private data files. For example, in a school:
- The Admissions Department maintained a student file containing Student Name, Roll No, Father's Name, Address, and Date of Birth.
- The Accounts Department maintained a separate fee ledger file containing Student Name, Roll No, Address, and Fee Payment Status.
- The Library Department maintained a third book file containing Student Name, Roll No, Class, and Borrowed Book Details.
3. The 6 Critical Flaws of File Processing Systems
- Data Redundancy (डेटा अतिरेक / Duplication): The same data is stored repeatedly in multiple independent files. Storing a student's name, home address, and guardian's phone number across the admissions, fee, library, and examination files wastes massive amounts of expensive disk storage and requires redundant typing.
- Data Inconsistency (डेटा असंगति / Contradictory Records): When redundant data exists across multiple files, updating a record in one file while failing to update it in another leads to contradictory, corrupt information. For example, if a student changes their residence from Danapur to Kankarbagh in Patna, the admissions department may update their address, but the accounts department might still possess the old address, causing notices and fee receipts to be sent to the wrong location.
- Difficulty in Accessing Data (डेटा खोज में जटिलता): File processing systems lack flexible ad-hoc querying. If the school principal suddenly asks: "List all Class 8 students living in Patna who have paid full fees and borrowed a science book," the system cannot answer. A software programmer must write a brand-new custom computer program from scratch to extract and cross-reference records across three separate files.
- Data Isolation (अलग-थलग फाइलें): Data is scattered across different files, often created in incompatible file formats (e.g., one file in text format, another in spreadsheet format, and a third in binary format). Writing application programs to retrieve interrelated data is extraordinarily complex.
- Integrity Problems (अखंडता बाधाओं की कमी): Real-world institutional rules (called integrity constraints), such as "Student age must be between 5 and 18" or "Fee amount cannot be negative," are hardcoded inside individual application programs. If constraints change, every single application program must be rewritten, risking data corruption if programmers make an error.
- Atomicity & Concurrent Access Anomalies (समवर्ती संपादन विसंगतियां): When multiple users access and update the same file simultaneously, transactions can collide and overwrite each other. Furthermore, if a system crashes halfway through a financial transfer (e.g. deducting money from a bank account before crediting the school fee account), file systems lack automatic rollback mechanisms, causing permanent financial discrepancies.