Project Objective
The primary objective of this project is to study and analyze climatological data for three cities inside and outside of the Dallas, TX region, and to classify these cities based on an “Urban Heat Island” (UHI) scale.
In climatology, UHI refers to cities that experience warmer temperatures than nearby rural areas, which occurs when land and natural vegetation are replaced by buildings, pavements, and surfaces that absorb and hold heat. This effect is also known as “micro climate” since a city’s infrastructure is creating its own local weather conditions.
By analyzing the micro climate data for Dallas, a major urban city in the country, and two suburban cities outside of Dallas—Denton and Arlington, we can create a classification system for different levels of intensities for UHIs and label these cities accordingly. Additionally, we will perform temporal analysis by comparing and contrasting various weather patterns for different heat intensities of UHIs.
Scope and Focus
This project will focus on assessing UHIs in various urban environments, particularly comparing the UHI intensity in the following settings:
Dallas (Significant City)
Analyzing the UHI in a major metropolitan area with high population density and urbanization. Factors such as pollution, land use, and climate will be considered to determine the UHIs’ intensity.
Arlington (Suburban Town)
Evaluating the UHI in a suburban setting, with a moderate population density and less urban development than a significant city. This comparison will help us understand how UHIs vary in less densely populated areas.
Denton (Rural City)
Examining the UHI in a rural city, where factors like lower population density, less pollution, and different land use patterns play a role in UHI intensity.
Dataset Description
The high-level goal of this project is to detect, analyze, and understand UHIs by leveraging data mining and machine learning to understand the microclimatic effects of urbanization in various metropolitan landscapes.
Climatological and hourly time-series data has been collected from several weather stations run by the National Weather Service (NWS), Federal Aviation Administration (FAA), and Department of Defense (DOD), which encompass data collected from airports and other significant areas. This data has been divided into three Local Climatological Datasets (LCD) for Arlington, Dallas, and Denton for the year 2022.
The dataset that we’ve gathered from National Center for Environmental Information (NCEI) (https://www.ncei.noaa.gov/) offers these key hourly summaries that we will be analyzing:
| DATE |
Date of the observation (year, month and day) along with time of observation given as a 4-digit number using a 24-hour clock in local standard time |
String |
| HourlyAverageDryBulbTemperature |
This is the dry-bulb temperature and is commonly used as the standard air temperature reported. It is given here in whole degrees Fahrenheit. |
Float |
| HourlyAverageWetBulbTemperature |
This is the wet-bulb temperature. It is given here in whole degrees Fahrenheit. |
Float |
| HourlyAverageDewPointTemperature |
This is the dew point temperature. It is given here in whole degrees Fahrenheit. |
Float |
| HourlyPrecipitation |
Total Liquid Content (TLC) water equivalent amount of precipitation for the day. |
Float |
| HourlyAverageSeaLevelPressure |
Sea level pressure given in inches of Mercury (in Hg). |
Float |
| HourlyAverageStationPressure |
Atmospheric pressure observed at the station during the time of observation. Given in inches of Mercury (in Hg). |
Float |
| HourlyAverageRelativeHumidity |
This is the relative humidity given to the nearest whole percentage. |
Float |
| HourlyAverageWindSpeed |
Speed of the wind at the time of observation given in miles per hour (mph). |
Float |
| HourlySustainedWindDirection |
Wind direction from true north using compass directions (e.g. 360 = true north, 180 = south, 270 = west, etc.). |
Float |
Additional data is included in the tabulated monthly summaries: maximum, minimum, and average temperatures; deviations from normal; ceiling height; visibility; weather patterns; heating and cooling degree days; fastest wind speeds and their directions; sky cover; and instances of sunshine, snowfall, and snow depth.
Three Datasets
1.) Arlington Dataset
(10938 rows x 124 columns)
|
STATION
|
DATE
|
LATITUDE
|
LONGITUDE
|
ELEVATION
|
NAME
|
REPORT_TYPE
|
SOURCE
|
HourlyAltimeterSetting
|
HourlyDewPointTemperature
|
HourlyDryBulbTemperature
|
HourlyPrecipitation
|
HourlyPresentWeatherType
|
HourlyPressureChange
|
HourlyPressureTendency
|
HourlyRelativeHumidity
|
HourlySkyConditions
|
HourlySeaLevelPressure
|
HourlyStationPressure
|
HourlyVisibility
|
HourlyWetBulbTemperature
|
HourlyWindDirection
|
HourlyWindGustSpeed
|
HourlyWindSpeed
|
Sunrise
|
Sunset
|
DailyAverageDewPointTemperature
|
DailyAverageDryBulbTemperature
|
DailyAverageRelativeHumidity
|
DailyAverageSeaLevelPressure
|
DailyAverageStationPressure
|
DailyAverageWetBulbTemperature
|
DailyAverageWindSpeed
|
DailyCoolingDegreeDays
|
DailyDepartureFromNormalAverageTemperature
|
DailyHeatingDegreeDays
|
DailyMaximumDryBulbTemperature
|
DailyMinimumDryBulbTemperature
|
DailyPeakWindDirection
|
DailyPeakWindSpeed
|
DailyPrecipitation
|
DailySnowDepth
|
DailySnowfall
|
DailySustainedWindDirection
|
DailySustainedWindSpeed
|
DailyWeather
|
MonthlyAverageRH
|
MonthlyDaysWithGT001Precip
|
MonthlyDaysWithGT010Precip
|
MonthlyDaysWithGT32Temp
|
MonthlyDaysWithGT90Temp
|
MonthlyDaysWithLT0Temp
|
MonthlyDaysWithLT32Temp
|
MonthlyDepartureFromNormalAverageTemperature
|
MonthlyDepartureFromNormalCoolingDegreeDays
|
MonthlyDepartureFromNormalHeatingDegreeDays
|
MonthlyDepartureFromNormalMaximumTemperature
|
MonthlyDepartureFromNormalMinimumTemperature
|
MonthlyDepartureFromNormalPrecipitation
|
MonthlyDewpointTemperature
|
MonthlyGreatestPrecip
|
MonthlyGreatestPrecipDate
|
MonthlyGreatestSnowDepth
|
MonthlyGreatestSnowDepthDate
|
MonthlyGreatestSnowfall
|
MonthlyGreatestSnowfallDate
|
MonthlyMaxSeaLevelPressureValue
|
MonthlyMaxSeaLevelPressureValueDate
|
MonthlyMaxSeaLevelPressureValueTime
|
MonthlyMaximumTemperature
|
MonthlyMeanTemperature
|
MonthlyMinSeaLevelPressureValue
|
MonthlyMinSeaLevelPressureValueDate
|
MonthlyMinSeaLevelPressureValueTime
|
MonthlyMinimumTemperature
|
MonthlySeaLevelPressure
|
MonthlyStationPressure
|
MonthlyTotalLiquidPrecipitation
|
MonthlyTotalSnowfall
|
MonthlyWetBulb
|
AWND
|
CDSD
|
CLDD
|
DSNW
|
HDSD
|
HTDD
|
DYTS
|
DYHF
|
NormalsCoolingDegreeDay
|
NormalsHeatingDegreeDay
|
ShortDurationEndDate005
|
ShortDurationEndDate010
|
ShortDurationEndDate015
|
ShortDurationEndDate020
|
ShortDurationEndDate030
|
ShortDurationEndDate045
|
ShortDurationEndDate060
|
ShortDurationEndDate080
|
ShortDurationEndDate100
|
ShortDurationEndDate120
|
ShortDurationEndDate150
|
ShortDurationEndDate180
|
ShortDurationPrecipitationValue005
|
ShortDurationPrecipitationValue010
|
ShortDurationPrecipitationValue015
|
ShortDurationPrecipitationValue020
|
ShortDurationPrecipitationValue030
|
ShortDurationPrecipitationValue045
|
ShortDurationPrecipitationValue060
|
ShortDurationPrecipitationValue080
|
ShortDurationPrecipitationValue100
|
ShortDurationPrecipitationValue120
|
ShortDurationPrecipitationValue150
|
ShortDurationPrecipitationValue180
|
BackupDirection
|
BackupDistance
|
BackupDistanceUnit
|
BackupElements
|
BackupElevation
|
BackupEquipment
|
BackupLatitude
|
BackupLongitude
|
BackupName
|
WindEquipmentChangeDate
|
|
72247953907
|
2022-01-01 00:18:00
|
32.65832
|
-97.09509
|
179.7
|
ARLINGTON MUNICIPAL AIRPORT, TX US
|
FM-16
|
7
|
29.66
|
65
|
67
|
0.03
|
-RA:02 BR:1 |RA |RA
|
NA
|
NA
|
93
|
OVC:08 15
|
NA
|
28.99
|
2.50
|
66
|
290
|
NA
|
8
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
2007-02-26
|
|
72247953907
|
2022-01-01 00:27:00
|
32.65832
|
-97.09509
|
179.7
|
ARLINGTON MUNICIPAL AIRPORT, TX US
|
FM-16
|
7
|
29.66
|
65
|
67
|
0.04
|
-RA:02 BR:1 |RA |RA
|
NA
|
NA
|
93
|
OVC:08 15
|
NA
|
28.99
|
3.00
|
66
|
270
|
NA
|
8
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
2007-02-26
|
|
72247953907
|
2022-01-01 00:53:00
|
32.65832
|
-97.09509
|
179.7
|
ARLINGTON MUNICIPAL AIRPORT, TX US
|
FM-15
|
7
|
29.65
|
63
|
66
|
0.04
|
BR:1 ||
|
NA
|
NA
|
90
|
FEW:02 13 BKN:07 25 OVC:08 32
|
29.62
|
28.98
|
5.00
|
64
|
310
|
NA
|
6
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
2007-02-26
|
|
72247953907
|
2022-01-01 01:53:00
|
32.65832
|
-97.09509
|
179.7
|
ARLINGTON MUNICIPAL AIRPORT, TX US
|
FM-15
|
7
|
29.65
|
63
|
65
|
T
|
BR:1 ||
|
NA
|
NA
|
93
|
OVC:08 26
|
29.62
|
28.98
|
5.00
|
64
|
330
|
NA
|
3
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
2007-02-26
|
|
72247953907
|
2022-01-01 02:53:00
|
32.65832
|
-97.09509
|
179.7
|
ARLINGTON MUNICIPAL AIRPORT, TX US
|
FM-15
|
7
|
29.63
|
63
|
65
|
T
|
BR:1 ||
|
0.02
|
8
|
93
|
OVC:08 26
|
29.61
|
28.96
|
4.00
|
64
|
310
|
NA
|
3
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
2007-02-26
|
2.) Dallas Dataset
(10536 rows x 124 columns)
|
STATION
|
DATE
|
LATITUDE
|
LONGITUDE
|
ELEVATION
|
NAME
|
REPORT_TYPE
|
SOURCE
|
HourlyAltimeterSetting
|
HourlyDewPointTemperature
|
HourlyDryBulbTemperature
|
HourlyPrecipitation
|
HourlyPresentWeatherType
|
HourlyPressureChange
|
HourlyPressureTendency
|
HourlyRelativeHumidity
|
HourlySkyConditions
|
HourlySeaLevelPressure
|
HourlyStationPressure
|
HourlyVisibility
|
HourlyWetBulbTemperature
|
HourlyWindDirection
|
HourlyWindGustSpeed
|
HourlyWindSpeed
|
Sunrise
|
Sunset
|
DailyAverageDewPointTemperature
|
DailyAverageDryBulbTemperature
|
DailyAverageRelativeHumidity
|
DailyAverageSeaLevelPressure
|
DailyAverageStationPressure
|
DailyAverageWetBulbTemperature
|
DailyAverageWindSpeed
|
DailyCoolingDegreeDays
|
DailyDepartureFromNormalAverageTemperature
|
DailyHeatingDegreeDays
|
DailyMaximumDryBulbTemperature
|
DailyMinimumDryBulbTemperature
|
DailyPeakWindDirection
|
DailyPeakWindSpeed
|
DailyPrecipitation
|
DailySnowDepth
|
DailySnowfall
|
DailySustainedWindDirection
|
DailySustainedWindSpeed
|
DailyWeather
|
MonthlyAverageRH
|
MonthlyDaysWithGT001Precip
|
MonthlyDaysWithGT010Precip
|
MonthlyDaysWithGT32Temp
|
MonthlyDaysWithGT90Temp
|
MonthlyDaysWithLT0Temp
|
MonthlyDaysWithLT32Temp
|
MonthlyDepartureFromNormalAverageTemperature
|
MonthlyDepartureFromNormalCoolingDegreeDays
|
MonthlyDepartureFromNormalHeatingDegreeDays
|
MonthlyDepartureFromNormalMaximumTemperature
|
MonthlyDepartureFromNormalMinimumTemperature
|
MonthlyDepartureFromNormalPrecipitation
|
MonthlyDewpointTemperature
|
MonthlyGreatestPrecip
|
MonthlyGreatestPrecipDate
|
MonthlyGreatestSnowDepth
|
MonthlyGreatestSnowDepthDate
|
MonthlyGreatestSnowfall
|
MonthlyGreatestSnowfallDate
|
MonthlyMaxSeaLevelPressureValue
|
MonthlyMaxSeaLevelPressureValueDate
|
MonthlyMaxSeaLevelPressureValueTime
|
MonthlyMaximumTemperature
|
MonthlyMeanTemperature
|
MonthlyMinSeaLevelPressureValue
|
MonthlyMinSeaLevelPressureValueDate
|
MonthlyMinSeaLevelPressureValueTime
|
MonthlyMinimumTemperature
|
MonthlySeaLevelPressure
|
MonthlyStationPressure
|
MonthlyTotalLiquidPrecipitation
|
MonthlyTotalSnowfall
|
MonthlyWetBulb
|
AWND
|
CDSD
|
CLDD
|
DSNW
|
HDSD
|
HTDD
|
DYTS
|
DYHF
|
NormalsCoolingDegreeDay
|
NormalsHeatingDegreeDay
|
ShortDurationEndDate005
|
ShortDurationEndDate010
|
ShortDurationEndDate015
|
ShortDurationEndDate020
|
ShortDurationEndDate030
|
ShortDurationEndDate045
|
ShortDurationEndDate060
|
ShortDurationEndDate080
|
ShortDurationEndDate100
|
ShortDurationEndDate120
|
ShortDurationEndDate150
|
ShortDurationEndDate180
|
ShortDurationPrecipitationValue005
|
ShortDurationPrecipitationValue010
|
ShortDurationPrecipitationValue015
|
ShortDurationPrecipitationValue020
|
ShortDurationPrecipitationValue030
|
ShortDurationPrecipitationValue045
|
ShortDurationPrecipitationValue060
|
ShortDurationPrecipitationValue080
|
ShortDurationPrecipitationValue100
|
ShortDurationPrecipitationValue120
|
ShortDurationPrecipitationValue150
|
ShortDurationPrecipitationValue180
|
BackupDirection
|
BackupDistance
|
BackupDistanceUnit
|
BackupElements
|
BackupElevation
|
BackupEquipment
|
BackupLatitude
|
BackupLongitude
|
BackupName
|
WindEquipmentChangeDate
|
|
72258013960
|
2022-01-01 00:53:00
|
32.83839
|
-96.83583
|
147.6
|
DALLAS FAA AIRPORT, TX US
|
FM-15
|
7
|
29.65
|
63
|
65
|
0.01
|
BR:1 ||
|
NA
|
NA
|
93
|
OVC:08 15
|
29.63
|
29.13
|
5
|
64
|
320
|
NA
|
9
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
2009-05-28
|
|
72258013960
|
2022-01-01 01:53:00
|
32.83839
|
-96.83583
|
147.6
|
DALLAS FAA AIRPORT, TX US
|
FM-15
|
7
|
29.64
|
63
|
65
|
0.01
|
-RA:02 BR:1 |RA |RA
|
NA
|
NA
|
93
|
OVC:08 22
|
29.62
|
29.12
|
6
|
64
|
360
|
NA
|
6
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
2009-05-28
|
|
72258013960
|
2022-01-01 02:53:00
|
32.83839
|
-96.83583
|
147.6
|
DALLAS FAA AIRPORT, TX US
|
FM-15
|
7
|
29.63
|
63
|
64
|
T
|
NA
|
0.01
|
8
|
96
|
OVC:08 25
|
29.61
|
29.11
|
7
|
63
|
000
|
NA
|
0
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
2009-05-28
|
|
72258013960
|
2022-01-01 03:53:00
|
32.83839
|
-96.83583
|
147.6
|
DALLAS FAA AIRPORT, TX US
|
FM-15
|
7
|
29.63
|
61
|
64
|
T
|
-RA:02 |RA |RA
|
NA
|
NA
|
90
|
OVC:08 26
|
29.61
|
29.11
|
9
|
62
|
080
|
NA
|
3
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
2009-05-28
|
|
72258013960
|
2022-01-01 04:53:00
|
32.83839
|
-96.83583
|
147.6
|
DALLAS FAA AIRPORT, TX US
|
FM-15
|
7
|
29.62
|
59
|
63
|
T
|
NA
|
NA
|
NA
|
87
|
OVC:08 28
|
29.60
|
29.10
|
10
|
61
|
110
|
NA
|
5
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
2009-05-28
|
3.) Denton Dataset
(10808 rows x 124 columns)
|
STATION
|
DATE
|
LATITUDE
|
LONGITUDE
|
ELEVATION
|
NAME
|
REPORT_TYPE
|
SOURCE
|
HourlyAltimeterSetting
|
HourlyDewPointTemperature
|
HourlyDryBulbTemperature
|
HourlyPrecipitation
|
HourlyPresentWeatherType
|
HourlyPressureChange
|
HourlyPressureTendency
|
HourlyRelativeHumidity
|
HourlySkyConditions
|
HourlySeaLevelPressure
|
HourlyStationPressure
|
HourlyVisibility
|
HourlyWetBulbTemperature
|
HourlyWindDirection
|
HourlyWindGustSpeed
|
HourlyWindSpeed
|
Sunrise
|
Sunset
|
DailyAverageDewPointTemperature
|
DailyAverageDryBulbTemperature
|
DailyAverageRelativeHumidity
|
DailyAverageSeaLevelPressure
|
DailyAverageStationPressure
|
DailyAverageWetBulbTemperature
|
DailyAverageWindSpeed
|
DailyCoolingDegreeDays
|
DailyDepartureFromNormalAverageTemperature
|
DailyHeatingDegreeDays
|
DailyMaximumDryBulbTemperature
|
DailyMinimumDryBulbTemperature
|
DailyPeakWindDirection
|
DailyPeakWindSpeed
|
DailyPrecipitation
|
DailySnowDepth
|
DailySnowfall
|
DailySustainedWindDirection
|
DailySustainedWindSpeed
|
DailyWeather
|
MonthlyAverageRH
|
MonthlyDaysWithGT001Precip
|
MonthlyDaysWithGT010Precip
|
MonthlyDaysWithGT32Temp
|
MonthlyDaysWithGT90Temp
|
MonthlyDaysWithLT0Temp
|
MonthlyDaysWithLT32Temp
|
MonthlyDepartureFromNormalAverageTemperature
|
MonthlyDepartureFromNormalCoolingDegreeDays
|
MonthlyDepartureFromNormalHeatingDegreeDays
|
MonthlyDepartureFromNormalMaximumTemperature
|
MonthlyDepartureFromNormalMinimumTemperature
|
MonthlyDepartureFromNormalPrecipitation
|
MonthlyDewpointTemperature
|
MonthlyGreatestPrecip
|
MonthlyGreatestPrecipDate
|
MonthlyGreatestSnowDepth
|
MonthlyGreatestSnowDepthDate
|
MonthlyGreatestSnowfall
|
MonthlyGreatestSnowfallDate
|
MonthlyMaxSeaLevelPressureValue
|
MonthlyMaxSeaLevelPressureValueDate
|
MonthlyMaxSeaLevelPressureValueTime
|
MonthlyMaximumTemperature
|
MonthlyMeanTemperature
|
MonthlyMinSeaLevelPressureValue
|
MonthlyMinSeaLevelPressureValueDate
|
MonthlyMinSeaLevelPressureValueTime
|
MonthlyMinimumTemperature
|
MonthlySeaLevelPressure
|
MonthlyStationPressure
|
MonthlyTotalLiquidPrecipitation
|
MonthlyTotalSnowfall
|
MonthlyWetBulb
|
AWND
|
CDSD
|
CLDD
|
DSNW
|
HDSD
|
HTDD
|
DYTS
|
DYHF
|
NormalsCoolingDegreeDay
|
NormalsHeatingDegreeDay
|
ShortDurationEndDate005
|
ShortDurationEndDate010
|
ShortDurationEndDate015
|
ShortDurationEndDate020
|
ShortDurationEndDate030
|
ShortDurationEndDate045
|
ShortDurationEndDate060
|
ShortDurationEndDate080
|
ShortDurationEndDate100
|
ShortDurationEndDate120
|
ShortDurationEndDate150
|
ShortDurationEndDate180
|
ShortDurationPrecipitationValue005
|
ShortDurationPrecipitationValue010
|
ShortDurationPrecipitationValue015
|
ShortDurationPrecipitationValue020
|
ShortDurationPrecipitationValue030
|
ShortDurationPrecipitationValue045
|
ShortDurationPrecipitationValue060
|
ShortDurationPrecipitationValue080
|
ShortDurationPrecipitationValue100
|
ShortDurationPrecipitationValue120
|
ShortDurationPrecipitationValue150
|
ShortDurationPrecipitationValue180
|
BackupDirection
|
BackupDistance
|
BackupDistanceUnit
|
BackupElements
|
BackupElevation
|
BackupEquipment
|
BackupLatitude
|
BackupLongitude
|
BackupName
|
WindEquipmentChangeDate
|
|
72258903991
|
2022-01-01 00:18:00
|
33.20883
|
-97.19922
|
194.6
|
DENTON MUNICPAL AIRPORT, TX US
|
FM-16
|
7
|
29.66
|
60
|
63
|
T
|
NA
|
NA
|
NA
|
90
|
BKN:07 30 OVC:08 36
|
NA
|
28.97
|
9.00
|
61
|
350
|
NA
|
5
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
2007-02-27
|
|
72258903991
|
2022-01-01 00:53:00
|
33.20883
|
-97.19922
|
194.6
|
DENTON MUNICPAL AIRPORT, TX US
|
FM-15
|
7
|
29.66
|
59
|
62
|
T
|
NA
|
NA
|
NA
|
90
|
OVC:08 37
|
29.64
|
28.97
|
9.00
|
60
|
000
|
NA
|
0
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
2007-02-27
|
|
72258903991
|
2022-01-01 01:53:00
|
33.20883
|
-97.19922
|
194.6
|
DENTON MUNICPAL AIRPORT, TX US
|
FM-15
|
7
|
29.63
|
60
|
62
|
T
|
-RA:02 |RA |RA
|
NA
|
NA
|
93
|
OVC:08 35
|
29.61
|
28.95
|
9.00
|
61
|
000
|
NA
|
0
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
2007-02-27
|
|
72258903991
|
2022-01-01 02:53:00
|
33.20883
|
-97.19922
|
194.6
|
DENTON MUNICPAL AIRPORT, TX US
|
FM-15
|
7
|
29.63
|
60
|
61
|
T
|
NA
|
0.03
|
8
|
97
|
OVC:08 42
|
29.61
|
28.95
|
7.00
|
60
|
000
|
NA
|
0
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
2007-02-27
|
|
72258903991
|
2022-01-01 03:53:00
|
33.20883
|
-97.19922
|
194.6
|
DENTON MUNICPAL AIRPORT, TX US
|
FM-15
|
7
|
29.63
|
60
|
61
|
0.00
|
BR:1 ||
|
NA
|
NA
|
97
|
OVC:08 45
|
29.61
|
28.95
|
6.00
|
60
|
000
|
NA
|
0
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
NA
|
2007-02-27
|
Questions
How does Urban Heat Island (UHI) intensity vary between urban and rural settings, such as Dallas, Arlington, and Denton, throughout a given year, and what methods can be employed to classify and interpret these varying intensity levels?
Explanation: This question highlights the investigation of variations in UHI intensity between metropolitan cities and rural areas such as Arlington, Dallas, and Denton. By classifying UHI intensity in terms of multi-class classification into levels, the aim is to develop an approach that provides a comprehensive understanding of how urban and rural environments influence these observed differences in a given year.
How can time series data visualizations effectively illustrate the variations in Urban Heat Island (UHI) intensity across metropolitan and rural areas like Arlington, Dallas, and Denton over a given year, highlighting the distinct temporal patterns of UHI levels?
Explanation: This question dives into the exploration of variations in the UHI intensity in metropolitan cities and rural areas like Arlington, Dallas and Denton throughout a specific year. Time series analysis will be used to uncover changes over seasons and highlight the levels of UHI. By employing techniques this investigation aims to provide an easy understanding of how UHI intensity changes over seasons identifying patterns that differentiate between urban heat impacts, in metropolitan and rural environments across the specified region.
Analysis Plan
Data Pre-Processing
Objective: Prepare the dataset for analysis by cleaning and structuring the data.
- Merge datasets from different locations (Dallas, Arlington, Denton) into a unified format.
- Identify and handle missing values through imputation.
- Convert data types as necessary for consistency.
- Normalize and standardize data to ensure comparability.
EDA (Exploratory Data Analysis)
Objective: Gain initial insights into the dataset and identify patterns.
Visualize key metrics such as temperature, humidity, and wind patterns.
Identify initial trends and seasonal variations.
Perform basic statistical analyses to understand data distributions.
Feature Engineering
Objective: Enhance the dataset with additional relevant features for analysis.
Performing feature selection by selecting relevant features for the modeling phase.
Develop a new feature for the classification task that defines the level of UHI intensity (High, Medium, Low). This feature will be derived based on specific conditions and thresholds of key parameters like temperature, humidity, wind speed, etc.
Create new features that could influence UHI intensity, such as time of day, day of the week, and season.
Temporal Analysis
Objective: Analyze UHI intensity over time to identify trends and anomalies.
Conduct time series analysis to explore how UHI intensity changes over various time frames (hourly, daily, seasonally, annually).
Identify peak periods of UHI intensity and investigate the underlying factors contributing to these peaks.
Compare temporal patterns across different locations (urban vs. rural) to understand how geographical factors influence UHI intensity.
Model Development and Evaluation
Objective: Develop and assess models that classify and predict UHI intensity.
Build classification models to distinguish between various UHI intensity levels.
Optimize models using techniques like cross-validation.
Evaluate models using appropriate metrics (accuracy, precision, recall, etc.).
Insight Generation and Recommendations
Objective: Derive actionable insights and provide recommendations
Analyze model results to understand the key effects of UHI intensity.
Reporting
- Compile all reports and visualizations into one report, then prepare and deliver the final presentation on our results and overall UHI assessments.
Weekly Plan of Attack
Week 1
11/8/23 - 11/15/23 |
Setting up environment; data blending. |
Dhanya, Udit |
|
Identify missing values and perform imputation to deal with missing values. |
Riyanshi, Ajinkya |
|
Data type conversions. |
Kendall |
Week 2
11/15/23 - 11/22/23 |
Visualization of key metrics. |
Udit, Dhanya |
| - |
Feature engineering and selection. |
Riyanshi |
| - |
Data normalization and standardization. |
Kendall, Ajinkya |
Week 3
11/22/23 - 11/29/23 |
Implement Temporal Analysis. |
Riyanshi, Kendall, Dhanya |
| - |
Analyze trends over the months (seasons). |
Udit, Ajinkya |
Week 4
11/29/23 - 12/6/23 |
Build classification models. |
Dhanya, Kendall |
| - |
Model optimization & cross-validate models. |
Riyanshi, Udit |
| - |
Evaluation metrics and performance analysis. |
Ajinkya |
Week 5 - Presentation
12/6/23- 12/11/23 |
Compile project documentation. |
Kendall, Dhanya |
|
Prepare final presentation. |
Udit, Riyanshi, Ajinkya |
Organization of the Project Repository
Below are the key folders within the Project repository:
data/: This directory is designated for essential data files required for the project, including input files.
images/: This folder serves as the storage location for project-related visual representations and plots.
presentation_files/: This folder is specifically reserved for materials relevant to project presentations.
_extra/: We will brainstorm and store analysis-related content that doesn’t directly affect the project workflow.
_freeze/: This folder stores the generated files during the build process, preserving the website’s specific state at a given moment.
_site/: This is where we will generate our static website files after rendering our Quarto documents.
.github/: This is where we will access and manage GitHub templates and workflow configurations.