Skip to content

Commit

Permalink
data profiler update
Browse files Browse the repository at this point in the history
  • Loading branch information
@ChanukaRavishan
ChanukaRavishan committed Nov 18, 2024
1 parent 843765d commit dd27dc3
Show file tree
Hide file tree
Showing 13 changed files with 270,582 additions and 11 deletions.
Binary file added .DS_Store
View file
Binary file not shown.
24 changes: 24 additions & 0 deletions css/app.css
View file
Original file line number Diff line number Diff line change
Expand Up @@ -121,3 +121,27 @@ svg :focus {
color: var(--mdc-theme-text-primary-on-background);
margin: 0;
}

/* */


.responsive-image {
width: 75%;
height: auto; /* Maintains the aspect ratio */
max-width: 100%; /* Ensures the image doesn't overflow on smaller devices */
margin: 0 auto;
display: block; /* Centers the image */
}

@media (max-width: 768px) {
.responsive-image {
width: 90%; /* Adjust the width for tablets and small screens */
}
}

@media (max-width: 480px) {
.responsive-image {
width: 100%; /* Adjust the width for mobile devices */
}
}

4 changes: 2 additions & 2 deletions index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
<html>

<head>
<title>LIRNEasia · Visualizations</title>
<title>LIRNEasia · DAP Projects</title>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<meta name="author" content="Viren Dias">
Expand All @@ -25,7 +25,7 @@
</div>
</header>
<main>
<h1 class="mdc-typography--headline2">Visualizations</h1>
<h1 class="mdc-typography--headline2">DAP</h1>
<ul class="card-list container">
<li class="mdc-card card">
<a href="./lacuna.html" class="mdc-card__primary-action" data-mdc-auto-init="MDCRipple" tabindex="0">
Expand Down
64 changes: 55 additions & 9 deletions lacuna.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,22 @@
<main>
<h1 class="mdc-typography--headline2">Lacuna</h1>
<div class="container">
<p class="mdc-typography--body1">Repository for the dataset collected in two parts: household electricity consumption data and survey data, collected across three survey rounds. Consumption data includes smart meter and non-smart meter data, while survey data is available from three separate waves, each containing four CSV files.</p>
<p class="mdc-typography--body1" align="center">Repository for the dataset collected in two parts: household electricity consumption data and three rounds of survey data. Consumption data includes smart meter and non-smart meter data.</p>
<img class="responsive-image" src="/Users/chanukaalgama/Desktop/web/d3-visualizations/resources/dataset_structure.png" alt="data set structure">
<ul>
<li>EC-1: Data from a longitudinal survey (with 3 rounds of data collection over a period of one
year) capturing the drivers, attitudes and behaviour around domestic energy consumption of over 4,000 consumers of the Lanka Electricity Company (LECO).
These 4,000 consumers will be divided into two primary groups:
<ul>
<li> 2000 households with smart electricity meters</li>
<li> 2000 households with traditional meters containing end-of-month consumption data. </li>
</ul>The survey will be representative for both smart-metered and non-smart-
metered households at +/- 2.2% margin of error at 95% confidence interval.</li>
<li>EC-2: Electricity consumption data for a 20-month period for the same 4,000 households on
which the survey is conducted. For the smart metered households, this will include detailed electricity profile
across different parameters (e.g., power, voltage, current) captured every 15 minutes. For non-
smart metered households, it will only be end-of-month total consumption.</li>
</ul>
</div>

<h2 class="mdc-typography--headline4">Dataset Overview</h2>
Expand All @@ -39,47 +54,78 @@ <h2 class="mdc-typography--headline4">Dataset Overview</h2>
<th style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Data Type</th>
<th style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">File Name</th>
<th style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Description</th>
<th style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Data quality profiling / Exploratory data analysis</th>
<th style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Features</th>
<th style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Download Link</th>
</tr>
</thead>
<tbody>
<!-- Consumption Data Rows -->
<tr>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;" rowspan="2">Consumption Data</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;" rowspan="2">EC-2</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Smart Meter Data</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Household electricity consumption recorded every 15 minutes via smart meters.</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">CUSTOMER_REF, Date, Time, Import kWh (kWh), Export kWh (kWh), Import kvarh (kvarh), Export kvarh (kvarh), Phase A Inst. Current (A), Phase ABC Power factor, Avg. Import kW (kW), Avg. Export kW (kW), Avg. Import kVA (kVA), Avg. Export kVA (kVA), Avg. Current (V), Avg. Voltage (V), Inst. Power factor</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-smart-meter-data.csv" target="_blank">View</a></td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Household_id, Date, Time, Import kWh (kWh), Export kWh (kWh), Import kvarh (kvarh), Export kvarh (kvarh), Phase A Inst. Current (A), Phase ABC Power factor, Avg. Import kW (kW), Avg. Export kW (kW), etc</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-smart-meter-data.csv" target="_blank">Download</a></td>
</tr>
<tr>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Non-Smart Meter Data</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Monthly Household electricity consumption data from households without smart meters.</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">CUSTOMER_REF, Date, Consumption</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-smart-meter-data.csv" target="_blank">View</a></td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Household_id, Date, Consumption</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-non-smart-meter-data.csv" target="_blank">Download</a></td>
</tr>

<!-- Survey Data Rows -->
<tr>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;" rowspan="3">Survey Data - Wave 1</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;" rowspan="7">EC-1 - Wave 1</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Demographics</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Household demographic details collected in Wave 1.</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Age, Gender, Education level, Occupation, etc.</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="/Users/chanukaalgama/Desktop/web/d3-visualizations/resources/data_profiling/w1_demographics.html" target="_blank">View</a></td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Household_id, Member_id, Age, Gender, Education level, Occupation, etc.</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-wave1-demographics.csv" target="_blank">Download</a></td>
</tr>
<tr>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Household information and history</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Information about the household, structure, materials used and history</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-smart-meter-data.csv" target="_blank">View</a></td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">No_of_electricity_meters, LECO CSC area, built_year, type_of_household, floor_area, etc</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-wave1-billing.csv" target="_blank">Download</a></td>
</tr>
<tr>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Appliance Usage</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Details on appliance usage patterns in Wave 1.</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Details on appliance usage patterns in the household.</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-smart-meter-data.csv" target="_blank">View</a></td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Appliance type, No of appliances of the type, hours used during last week </td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-wave1-appliance.csv" target="_blank">Download</a></td>
</tr>
<tr>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Room Roster</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Information about the rooms of the household on Wave 1 data.</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Information about the rooms in the household</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-smart-meter-data.csv" target="_blank">View</a></td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Room type, Roof material used, floor material, no of windows, no of lights, ACs, Fans in the room</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-wave1-billing.csv" target="_blank">Download</a></td>
</tr>

<tr>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Light Roster</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Information about the lights in the household</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-smart-meter-data.csv" target="_blank">View</a></td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Room_id, type_of_the_bulb, wattage_of_the_bulb, No_of_hours_used_last_week(daytime), No_of_hours_used_last_week(nighttime)</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-wave1-billing.csv" target="_blank">Download</a></td>
</tr>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Fan Roster</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Information about the Fans in the household</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-smart-meter-data.csv" target="_blank">View</a></td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Room_id, type_of_the_fan, No_of_hours_used_last_week(daytime), No_of_hours_used_last_week(nighttime)</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-wave1-billing.csv" target="_blank">Download</a></td>
</tr>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">AC Roster</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Information about the ACs in the household</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-smart-meter-data.csv" target="_blank">View</a></td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;">Room_id, type_of_the_AC, inverter_or_not, is_the_room_fully_sealed, wattage_of_the_ac, btu, No_of_hours_used_last_week(daytime), No_of_hours_used_last_week(nighttime)</td>
<td style="border: 1px solid #ddd; padding: 8px; word-wrap: break-word; white-space: normal;"><a href="link-to-wave1-billing.csv" target="_blank">Download</a></td>
</tr>
<!-- Repeat Survey Rows for Wave 2, Wave 3, etc. -->
</tbody>
</table>
Expand Down
Binary file added resources/.DS_Store
View file
Binary file not shown.
20,584 changes: 20,584 additions & 0 deletions resources/data_profiling/w1_ac_roster.html
View file

Large diffs are not rendered by default.

6,011 changes: 6,011 additions & 0 deletions resources/data_profiling/w1_appliances.html
View file

Large diffs are not rendered by default.

78,104 changes: 78,104 additions & 0 deletions resources/data_profiling/w1_demographics.html
View file

Large diffs are not rendered by default.

9,501 changes: 9,501 additions & 0 deletions resources/data_profiling/w1_fan_roster.html
View file

Large diffs are not rendered by default.

128,626 changes: 128,626 additions & 0 deletions resources/data_profiling/w1_household_information_and_history.html
View file

Large diffs are not rendered by default.

14,820 changes: 14,820 additions & 0 deletions resources/data_profiling/w1_light_roster.html
View file

Large diffs are not rendered by default.

12,855 changes: 12,855 additions & 0 deletions resources/data_profiling/w1_room_roster.html
View file

Large diffs are not rendered by default.

Binary file added resources/dataset_structure.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit dd27dc3

Please sign in to comment.