Data Quality Dashboard

Quality Inspection Dashboard

Last Updated: 2025-08-29 09:00

Inspection Dataset

July Notice Data

Total Records

1,260 Records

Data Accuracy

97 %

Error Records

2 Records

Recent Quality Inspection Detail Report (2025-08-29)

Inspection Result Summary

Total 1,260 records inspected.

- Duplicate Data: 0 Records

- Missing Values: 2 Records (Corrected)

- Column Mapping Accuracy: 97%

- Format Errors: 0 Records

Inspection Tools Used

Data Duplication Check Script (Python)
Null Value Detection Tool (v1.3)
Schema Mapping Validator
QA Checklist (2025-Q3)

Detailed Evidence

1. Snippet of Quality Inspection Log File

[2025-08-29 08:55:10] INFO: Quality check started for 'July Notice Dataset'.
[2025-08-29 08:55:12] INFO: Total 1260 records loaded.
[2025-08-29 08:55:15] INFO: Duplicate check completed. Found 0 duplicates.
[2025-08-29 08:55:20] WARNING: Missing value found in 'end_date' column. Record ID: 481.
[2025-08-29 08:55:21] WARNING: Missing value found in 'end_date' column. Record ID: 502.
[2025-08-29 08:55:25] INFO: Attempting to correct 2 missing values...
[2025-08-29 08:55:26] INFO: Correction successful.
[2025-08-29 08:56:00] INFO: Quality check finished. Accuracy: 97%.

2. Error Detection & Correction Details (Missing Value Correction)

Record ID	Column	Before	After
481	end_date	NULL	'2025-08-15'
502	end_date	NULL	'2025-08-20'

Column-level Quality Statistics

Detailed analysis for 33 columns from the 'July Notice Data' dataset.

Total Columns Inspected

Columns Passed

Columns with Warnings

Field Analysis Details

Field Name	Data Type	Status	Completeness	Uniqueness	Validity
notice_id	INTEGER	OK	100%	100%	100%
title	VARCHAR(255)	OK	100%	98.5%	100%
org_name	VARCHAR(100)	OK	100%	34.2%	100%
start_date	DATE	OK	100%	N/A	100%
end_date	DATE	Warning	99.8%	N/A	100%
attachment_url	TEXT	Warning	99.8%	100%	99.9%
column_7	VARCHAR	OK	100%	99%	100%
column_8	BOOLEAN	OK	100%	N/A	100%
column_9	TEXT	OK	99%	80%	100%
column_10	DECIMAL	OK	100%	95%	100%

History & Reports

Past Inspection Reports

Run ID	Timestamp	Dataset Name	Records	Accuracy	Errors Found	Status
RUN-20250829-0900	2025-08-29 09:00	July Notice Data	1,260	97%	2	Corrected
RUN-20250828-1430	2025-08-28 14:30	July Notice Data (Test)	100	100%	0	Completed
RUN-20250730-1000	2025-07-30 10:00	June Full Dataset	8,450	88%	1,014	Failed
RUN-20250629-1100	2025-06-29 11:00	May Full Dataset	7,900	99.5%	40	Corrected
RUN-20250530-1000	2025-05-30 10:00	April Full Dataset	7,500	99.2%	60	Corrected

Rule Settings

Active Rules (6)

Check for Duplicates (notice_id)

Ensures all records have a unique 'notice_id'.

Active Edit

Check for Null Values (end_date)

Flags records where 'end_date' is missing. Auto-correct is ON.

Active Edit

Validate Format (start_date, end_date)

Checks if dates match 'YYYY-MM-DD' format.

Active Edit

Check Value Range (amount)

Ensures 'amount' column is between 0 and 1,000,000.

Active Edit

Check Allowed Values (category)

Ensures 'category' is one of ['Type A', 'Type B', 'Type C'].

Active Edit

Attachment URL Check

Verifies that 'attachment_url' is a valid URL (Rule Paused).

Paused Edit