Tag Archives: Geography

Creating & Using Location Shapefiles

.. GIS tools and methods to develop and update location shapefiles .. location shapefiles are essential to most GIS applications. Location shapefiles, or point shapefiles, enable viewing/analyzing locations on a map and attributes of these locations such store or customer ID, street address, city, date updated, value, ZIP code and wide-ranging attributes about the location. This section reviews tools and methods to develop and use location shapefiles. See more detail about topics covered in this section in the related Web page.

Viewing/Analyzing Store Locations in the Dallas, TX Area
The following graphic illustrates how store locations can be shown in context of other geography and associated demographic-economic attributes. This view shows store locations (red markers) in context of Dallas city (blue cross-hatch pattern) and broader metro area. Markers shown in this view are based on a location shapefile created using steps described below. The identify tool is used to click on a location and show attributes in a mini-profile.

.. view developed with ProximityOne CV XE GIS and related GIS project.

View the locations contextually with thematic patterns by tract or other geography. Combine views of store, customer, agent, competitor and other location shapefiles.
The following view shows patterns of median household income by census tract.

.. view developed with ProximityOne CV XE GIS and related GIS project.

Development of location shapefiles often starts with a list of addresses. Locations are not always address-oriented; they might be geographically dispersed measurement or transaction locations — having no address assigned. In applications reviewed here, locations are organized as rows in a CSV file. Each CSV file contains like-structured attributes for each location. The example used in this section uses store locations located in the Dallas, TX area.

There are two basic methods used to create location shapefiles: 1) geocoding address-data contained in the source data file or 2) using the latitude-longitude of the location included in the source data file record. The focus here is on option 2 — using the latitude-longitude of the location already present in the source data file.

Creating a Location Shapefile
The process of creating a location shapefile uses the CV XE GIS Manage Location Shapefile feature. With CV running, the process is started with File>Tools>ManageLocationShapefile. The following form appears.

.. ManageLocationShapefile feature/operation in ProximityOne CV XE GIS.

CV XE GIS provides other ways to create location shapefiles:
• Tools>AddShapes>Points — click points on the map window canvas.
• Tools>FindAddress — creates a single point shapefile based on specified address.
• Tools>FindAddress (Batch) — creates a point shapefile based on specified file of address records.
See details in User Guide.

Steps to Create a Location Shapefile
The process of creating the shapefile “C:\cvxe\1\locations1pts.shp” can be viewed by clicking the Run button on the form (with CV running). Two input CSV structured files are required:
• data definition file
• source data file

There are two sets of illustration location input files included with the CV installer:
• locations1_dd.csv and locations1.csv (7 locations in Johnson County, KS)
• locations2_dd.csv and locations2.csv (252 locations in Dallas and Houston)
These files are located in the \1 (typically c:\cvxe\1) folder. The marker/location shapefile used in the map shown above was created using the lcoations2 input files.

Data Definition File
The Data Definition (DD) file is an ASCII/text file structured as a CSV file. It may created with any text editor. The DD file is specific to the source data file. But in the case of recurring source data files for different periods the same DD file might apply to many source data files. There are several rules and guidelines for development of the DD file:
• there is one line/record for each field in the source data file.
• each line/record must be structured in an exact form:
.. each line/record is comprised of exactly 4 elements separated by a comma:
.. 1 field name for subject matter item
– must consist of 1 to 10 characters and include no blanks or special characters
.. 2 field type: C for character, N for numeric
.. 3 field length: an integer specifying the maximum with of the field
.. 4 maximum number of decimals for field (value is 0 for character fields)
The DD File must include three final fields:
LATITUDE,n,12,6
LONGITUDE,n,12,6
GEOID,c,15,0
The structure of these three DD file records must be as shown above. The source data file, described below, must have the LATITUDE and LONGITUDE fields populated with accurate values. The GEOID field may populated with either an accurate value of placeholder value like 0.

Example. Data for each store for the default DD file name “C:\cvxe\1\locations1_dd.csv” include the following fields/attributes:
  NAME,C,45,0
STORE,c,15,0
ADDRESS,c,60,0
CITY,c,40,0
LATITUDE,n,12,6
LONGITUDE,n,12,6
GEOID,c,15,0

Optionally create a DD File using the Create DD File button on the form. Clicking this button will create a DD File containing attributes of the dBase file specified in the associated edit box. The DD File name is created from the dBase file name. If the dBase file name is “c:\cvxe\1\locations1pts.dbf”, the DD File will be named “c:\cvxe\1\locations1pts_dd.csv”.

About the GEOID
The GEOID is a 15 character code which defines the Census 2010 census block containing each location. The GEOID is generally assigned by the ManageLocationShapefile operation and is one of the important and distinctive features of this tool. The GEOID is used to uniquely determine, with the GIS application, any of the following: state, county, census tract, block group, or census block.

The GEOID, as used in this section, is the 15 character Census 2010 geocode for the census block. The GEOID value 481130002011012 (see in location profile in map at top of section) is structured as:
state FIPS code: 48 (2 chars)
county FIPS code: 113 (3 chars)
census tract code 000201 (6 chars)
census block code: 1012 (4 chars) (block group code: 1 — first of 4 characters)

About the Source Data File
The Source Data File is an ASCII/text file structured as a CSV file. It is typically developed by exporting/saving an Excel or dBase file in CSV structure. There are several rules and guidelines for development of the source data file:
• fields must be structured and arranged as defined in the DD File.
• character fields must not contain embedded commas.
• final items in record sequence must be:
.. LATITUDE – must have accurate decimal degree value; 6 digit precision suggested.
.. LONGITUDE- must have accurate decimal degree value; 6 digit precision suggested.
.. GEOID – this may be 0, not assigned or the accurately assigned GEOID value.
– optionally create/rewrite the GEOID used in the new shapefile.

Updates; Combining Vintages of Location Attributes
Location based data might update frequently, even daily. The recommended method to add, update and extend the scope of location-based data is to create new address shapefiles corresponding to different vintages or dates covered. The structure of the files must be the same so that they files can be used together or separately. Suppose there is one set of data covering year to date and a second set of data covering the following month. The ManagePointShapefile operation would be run once for each time period. Two shapefiles would be created. These shapefiles may be added to a GIS project and used separately or in combination to view/analyze patterns.

Join me in a Data Analytics Lab session to discuss more details about accessing and using wide-ranging demographic-economic data and data analytics. Learn more about using these data for areas and applications of interest.

About the Author
— Warren Glimpse is former senior Census Bureau statistician responsible for innovative data access and use operations. He is also the former associate director of the U.S. Office of Federal Statistical Policy and Standards for data access and use. He has more than 20 years of experience in the private sector developing data resources and tools for integration and analysis of geographic, demographic, economic and business data. Contact Warren. Join Warren on LinkedIn.

Tools to Analyze County Demographic-Economic Characteristics

.. demographic-economic characteristics of counties are essential for business development, market analysis, planning, economic development, program management and general awareness of patterns and trends. This section provides access to data and tools to examine these data for all counties in the U.S. This annual update includes geographic area characteristics based on ACS 2015 data.  The tools/data are organized into four related sections summarized below.

1. General Demographics
View interactive table at http://proximityone.com/us155dp1.htm
Patterns of School Age Population by County
Use GIS tools to visually examine county general demographics as illustrated below. The following view shows patterns of percent population ages 5 to 17 years of age by county — item D001-D004-D018 in the interactive table. Create your own views.

… view developed using the CV XE GIS software.

2. Social Characteristics
View interactive table at http://proximityone.com/us155dp2.htm 
Patterns of Educational Attainment by County
– percent college graduate
Use GIS tools to visually examine county social characteristics as illustrated below. The following view shows patterns of percent college graduate by county — item S067 in the interactive table. Create your own views.

… view developed using the CV XE GIS software.

3. Economic Characteristics
View interactive table at http://proximityone.com/us155dp3.htm 
Patterns of Median Household Income by County
Use GIS tools to visually examine county economic characteristics as illustrated below. The following view shows patterns median household income by county — item E062 in the interactive table. Create your own views.

… view developed using the CV XE GIS software.

4. Housing Characteristics
View interactive table at http://proximityone.com/us155dp4.htm 
Patterns of Median Housing Value by County
Use GIS tools to visually examine county housing characteristics as illustrated below. The following view shows patterns median housing value by county — item E062 in the interactive table. Create your own views.

… view developed using the CV XE GIS software.

Join me in a Data Analytics Lab session to discuss more details about accessing and using wide-ranging demographic-economic data and data analytics. Learn more about using these data for areas and applications of interest.

About the Author
— Warren Glimpse is former senior Census Bureau statistician responsible for innovative data access and use operations. He is also the former associate director of the U.S. Office of Federal Statistical Policy and Standards for data access and use. He has more than 20 years of experience in the private sector developing data resources and tools for integration and analysis of geographic, demographic, economic and business data. Contact Warren. Join Warren on LinkedIn.

America’s Cities: Demographic-Economic Characteristics Annual Update

.. tools and data to interactively examine demographic-economic characteristics of America’s 29,321 cities/places .. understanding demographic-economic characteristics of cities and places is essential for business development, market analysis, planning, economic development, program management and general awareness of patterns and trends. This section provides access to data and tools to examine characteristics of all cities/places in the U.S. This annual update includes data for 29,321 cities/places based on ACS 2015 data.

Accessing the Data; Using Interactive Tables
Each of the four links below opens a new page providing access to U.S. by city/place interactive tables — by type of subject matter. Use tools and usage notes below table to select operations to perform queries, sort and select columns.
General Demographics
Social Characteristics
Economic Characteristics
Housing Characteristics

How the the Tables/Data Can be Used
The following table shows data derived from the Economic Characteristics table. The top 10 cities/places having the highest median household income ($MHI) are shown. The table also shows population, median family income ($MFI) and per capita income ($PCI). The $250,000 value is a cap; the actual value is $250,000 or higher. Use the interactive tables to create similar views for states of interest. Use the button below the table to select/view cities within a selected metro. Compare attributes of cities of interest to a peer group based on population size.

Visual Analysis of City/Place Population Patterns
Use GIS resources to visually examine city/place demographic-economic patterns. The following view shows patterns of population percent change by city in the Charlotte, NC-SC metro area.

… view developed using the CV XE GIS software.
… click map for larger view and details.

Related Data
Cities/Places Main Section
Citie Population Estimates & Trends, 2010-15

More About Using These Data
Using ACS 1-year and 5-year data

Join me in a Data Analytics Lab session to discuss more details about accessing and using wide-ranging demographic-economic data and data analytics. Learn more about using these data for areas and applications of interest.

About the Author
— Warren Glimpse is former senior Census Bureau statistician responsible for innovative data access and use operations. He is also the former associate director of the U.S. Office of Federal Statistical Policy and Standards for data access and use. He has more than 20 years of experience in the private sector developing data resources and tools for integration and analysis of geographic, demographic, economic and business data. Contact Warren. Join Warren on LinkedIn.

Accessing & Using ZIP Code Demographics

.. tip of the day .. a continuing weekly or more frequent tip on developing, integrating, accessing and using geographic, demographic, economic and statistical data. Join in .. tip of the day posts are added to the Data Analytics Blog on an irregular basis, normally weekly. Follow the blog to receive updates as they occur.

… February 2017 updates .. 5 ways to access/analyze the most recent estimates of median housing value and other subject matter by ZIP Code area .. updates on accessing/downloading/using American Community Survey (ACS1115) 5-year estimates. See more detail in related Web section.

Site analysis (Option 5 below)
– create site analysis profiles from a location/ZIP code.

Contents
Five data access and use options, listed in the links below, are reviewed. Each method illustrates how ZIP code demographic-economic data can be accessed/ analyzed/used in different contexts. The most basic data access/data download is illustrated in Option 3. The following links open new windows that take you to the related section with more detail.
Option 1 – View the data as a thematic pattern map.
Option 2 – View, compare, rank query data in interactive tables.
Option 3 – Access data using API Tools; create datasets.
.. Option 3a – Extended ZIP Code subject matter access.
.. Option 3b – ZIP code urban/rural data access.
.. Option 3c – Additional API ACS data access resources.
Option 4 – View $MHI in structured profile in context of related data.
Option 5 – Site analysis – view circular area profile from a location.

Related ZIP Code Data Access & Use sections
Interactive access to demographics based on an address
Summary of ZIP Code Data Resources & Tools
10 Reasons to use Census Tracts Versus ZIP Codes
Analyzing Census Tract Demographics by ZIP Code Area
ZIP Code to Census Tract Equivalence Table
ZIP Code Urban/Rural Geography & Demographics
Mapping ZIP Code Demograhics
Housing Price Index by 5-digit ZIP Code – time series; annual updates
Housing Price Index by 3-digit ZIP Code – time series; quarterly updates
ZIP Code Business Establishment, Employment & Earnings by industry
ZIP Code Retail Trade Establishment & Sales by industry
ZIP Code Equivalence Tables — ZIP Code to School District

Join me in a Data Analytics Lab session to discuss more details about accessing and using wide-ranging demographic-economic data and data analytics. Learn more about using these data for areas and applications of interest.

About the Author
— Warren Glimpse is former senior Census Bureau statistician responsible for innovative data access and use operations. He is also the former associate director of the U.S. Office of Federal Statistical Policy and Standards for data access and use. He has more than 20 years of experience in the private sector developing data resources and tools for integration and analysis of geographic, demographic, economic and business data. Contact Warren. Join Warren on LinkedIn.

Housing Value Appreciation by 3-Digit ZIP Code: 2015Q3-2016Q3

.. tools, data and methods to examine housing value appreciation from 2015Q3 to 2016Q3 by 3-digit ZIP code based on the Housing Price Index (HPI).  How is the housing value changing in areas of interest?  How does housing value appreciation compare among a set of ZIP codes? Which ZIP code areas have the highest and lowest housing value appreciation in a state, region custom defined areas of interest? The HPI is calculated in part using home sales price information from Fannie Mae- and Freddie Mac-acquired mortgages. The U.S. all transactions HPI rose 5.6 percent from the 3rd quarter of 2015 to the 3rd quarter of 2016. Rank, compare, evaluate quarterly or annual housing value change for the approximate 900 3-digit ZIP code areas using the interactive table.

3-Digit ZIP Codes with Highest Housing Value Appreciation
Derived from the interactive table below this table shows the ten 3-digit ZIP codes having the highest housing value appreciation over the year 2015Q3-2016Q3. The areas are ranked on percent HPI change (rightmost column).

Gaining Insights in Housing Prices, Conditions & Markets
.. data, tools and methods to assess characteristics, patterns & trends
.. weekly Housing Data Analytics Lab sessions

Patterns of Housing Value Change by 3-Digit ZIP Code
The following graphic shows housing value appreciation 2015Q3-2016Q3 by 3-digit ZIP code based on the HPI. Use related GIS tools to zoom-in, assign labels, show in context with other geography.

– view developed using CVGIS and related GIS project.
– Click graphic for larger view and details;

Examining Housing Appreciation by 3-Digit ZIP Code
Use the interactive table below to view/rank/compare the non-seasonally adjusted “all transactions” HPI for the most recent 5 quarters for all 3-digit ZIP codes. The ranking table shows the latest quarterly HPI data and preceding quarters for one year earlier. This table will be updated on February 24, 2017, with 4th quarter 2016 data and related prior quarterly estimates and re-computed quarterly change values (last column).

Using the Interactive Table
The following graphic illustrates use of the HPI by 3-digit ZIP code interactive table. HPI data are shown for the quarterly period 2015Q3 through 2016Q3. The state selection below the table has been used to select only California ZIP codes. The Group1 button below the table has been used to select ZIP codes with a 2016Q3 HPI value of 175 ore more. The table is then sorted on the rightmost column. The resulting view shows that among all California 3-digit ZIPs having an HPI of 175 or more in 2016Q3, ZIP code 948/Richmond CA had the highest housing value appreciation — a 10.6% increase over the year.

Use the interactive table to examine states or ZIP code groups of interest.

Join me in a Data Analytics Lab session to discuss more details about accessing and using wide-ranging demographic-economic data and data analytics. Learn more about using these data for areas and applications of interest.

About the Author
— Warren Glimpse is former senior Census Bureau statistician responsible for innovative data access and use operations. He is also the former associate director of the U.S. Office of Federal Statistical Policy and Standards for data access and use. He has more than 20 years of experience in the private sector developing data resources and tools for integration and analysis of geographic, demographic, economic and business data. Contact Warren. Join Warren on LinkedIn.

National Children & Education Statistics Program Updates

.. NCES Program updates .. tools, data & methodology to examine national scope children & education .. school, school district & extended geographic-statistical data with drill-down to school and intersection level. See more about the NCES Program below.

New this Week
ACS 2015 school district demographic-economic interactive tables
– view, compare, analyze selected/all U.S. school districts
– more focused blog updates coming soon.

School Districts with Highest Median Household Income
Use the interactive table to examine economic characteristics of school districts. Below is a list of the 10 school districts having the highest median household income developed using the Economic Characteristics interactive table. Develop similar views for metros and states of interest.

– ranked on item E062 — median household income.
– click graphic for larger view.

Use GIS tools to develop thematic pattern maps such as the one shown below with NCES GIS projects. Select from hundreds of statistical measures. Create your own regional;/district views. Integrate other data.

Patterns of Economic Prosperity by School District
– median household income (item E062 in table)

– view developed with CVGIS software & related GIS project and data.
– click graphic for larger view.

See the School Districts Economic Characteristics Interactive Table.

About the National Children & Education Statistics Program
The National Children & Education Statistics (NCES) Program provides access to tools, data & methodology to examine national scope children’s demographics & education-related characteristics. These resources enable stakeholders to view and analyze detailed geographic and statistical data at the school, neighborhood, community, attendance zone, school district and higher level geography. Integrate these data with drill-down demographic-economic data to the census block and intersection levels. Examine characteristics of schools, school districts and education data with related and higher level geography including urban/rural, cities, counties, metros, state and the U.S.

See NCES Main Section.

Contents: Summary of NCES Program Resources
Click a link to view more detail on a selected topic.
Updates: New Resources, Events & Related Topics
Analytics, Blogs, Studies
Using Software Tools & Datasets
01 Mapping & Visual Analysis Tools
02 School District Annual Demographic-Economic Data Resources
03 Children’s Demographics & Living Environment by School District
04 School District Enrollment & Operational Characteristics
05 School District Finances: Sources & Uses of Funds
06 School District Geographic Size & Characteristics
07 School District-ZIP Code Area Relationship Table
08 K-12 Public Schools
09 K-12 Private Schools
10 K-12 Public School Attendance Zones
11 K-12 Public Schools by Urban/Rural Status
12 Census Tract Demographic-Economic Characteristics
13 Metropolitan Area Situation & Outlook Reports

Join me in a Data Analytics Lab session to discuss more details about accessing and using wide-ranging demographic-economic data and data analytics. Learn more about using these data for areas and applications of interest.

About the Author
— Warren Glimpse is former senior Census Bureau statistician responsible for innovative data access and use operations. He is also the former associate director of the U.S. Office of Federal Statistical Policy and Standards for data access and use. He has more than 20 years of experience in the private sector developing data resources and tools for integration and analysis of geographic, demographic, economic and business data. Contact Warren. Join Warren on LinkedIn.

Creating Maps & GIS Projects

.. follow these steps to create custom maps & GIS projects .. while maps are “everywhere,” there is a continuing need to make new maps. Reasons for this include changing underlying geography, new features (like stores or customers to be viewed), visually examining geographic relationships not available elsewhere (e.g., census tracts and ZIP codes), different geographic depictions for an area (smoothed versus precise vertices) and other reasons. A map can provide view(s) that relate to geospatial analysis; map visualization can be indispensable (showing road features adjacent to selected properties).

View of Initial Map Objective — University Park, TX; Dallas Metro area
Census tracts (black boundary) shown with census tract code as label.

— view developed using CV XE GIS software

Follow steps in this section to make a map like above for any area in the U.S. This section provides an overview of how to use the CVGIS software to quickly build a map. It is actually more than a map, it is the process of building a GIS project. A map is one rendering that can be displayed, and optionally published, using a GIS project. Map/GIS project development steps reviewed here can be performed using the no fee CVGIS software and no fee data resources, CVGIS Levels 1 and higher can save the GIS project and have additional geography available. With geographic extension, the process illustrated here can work for any place in the world. A GIS project is a file itself that contains references to map files (shapefiles) located on your computer. Once a GIS project has been created and saved, it can be immediately opened with CVGIS using the File>Open operation. After turning your computer off, and restarting it, the GIS project can be re-opened to display the same view as saved in an earlier session.

No Previous GIS/Mapping Experience Required
This section is designed for use by anyone including those with no previous GIS/mapping experience. Requirements are a Windows computer and Internet access. This section is a part of a module used in the Certificate in Data Analytics and the CVGIS Certification Programs. Developers can also benefit from this and related tutorials to learn more about how GIS can be integrated with other data analytics tools and methods.

Making Maps Steps
The objective of this session is to develop a map (and GIS project) to view characteristics of census tract “48113019301”. The first step in making a map (GIS project) is to have a clear objective. This 11 character geocode uniquely identifies this Census 2010 census tract among all other 73,057 tracts in the U.S. See more about census tract geography and geocodes. While this application shows a process for adding only two layers, it could be extended by adding more. Similarly, while this application uses a census tract boundary files (shapefile), alternatives are census blocks, block groups, ZIP code areas, among others.

These steps should take an inexperienced user 10-15 minutes to develop a new CVGIS project view. If anything becomes confused, close the program and start over.
Step 1. Install CVGIS (1/1/2017 or later version)
Step 2. Open Base Project
Step 3. Get Census Tract Shapefile
Step 4. Get Roads Shapefile
Step 5. Modify Map View
Step 6. Optionally Save GIS Project

The view should now be similar to the view at the top of this section.

Next Steps
Try the process yourself with geography of interest to you. View/use other “Creating Maps & GIS Projects” tutorials to learn about:
• integrating subject matter
• developing and using thematic maps
• creating site profiles

Join me in a Data Analytics Lab session to discuss more details about accessing and using wide-ranging demographic-economic data and data analytics. Learn more about using these data for areas and applications of interest.

About the Author
— Warren Glimpse is former senior Census Bureau statistician responsible for innovative data access and use operations. He is also the former associate director of the U.S. Office of Federal Statistical Policy and Standards for data access and use. He has more than 20 years of experience in the private sector developing data resources and tools for integration and analysis of geographic, demographic, economic and business data. Contact Warren. Join Warren on LinkedIn.