Category Archives: data analytics

Examining State-to-State Geographic Mobility

.. tools, resources and insights to examine U.S. by state migration 2011-2017 and migration flows in 2016 .. this post is an excerpt from the more detailed Web page http://proximityone.com/statemigration.htm.

In examining future demographic trends, the most challenging component of change to project (develop data values into the future) is migration. Migration, comprised net domestic and net international migration, is a function of many factors whose cause and effect behavior can change year by year, and geographic area by area. While this section is focused on states, the same scope of data is available to the county and sub-county levels. In this section, U.S. by state migration is examined using two data sources: annual population and components of change model-based estimates (2010-2017 model-based estimates) and annual American Community Survey estimates (ACS 2016 estimates). While these Census Bureau programs are highly related, the migration data/subject matter differ some.

State Net Domestic Migration, 2011-2017
The following graphic shows patterns net domestic migration for the period 2011-2017, based on the model-based estimates. The patterns of migration change, direction and magnitude are immediately evident. Click on the graphic to see a larger view showing more detail. Expand browser to full screen for best quality view. The larger view shows a portion of a mini-profile for Florida. The mini-profile illustrates how these data are comprised … annual net domestic migration estimates and the sum over the years 2011-2017. See the interactive table to view these data, and related components of change, in a tabular, numeric form. Use the GIS project (details here) to create similar views for any state; visual analysis of outmigration for any state showing outmigration by destination state. Label areas as desired. Add other layers. Add your own data.

View created with CV XE GIS. Click graphic for larger view with more detail.

State OutMigration by Destination State
The model-based estimates, reviewed above, do not provide detail on state-to-state migration. Those data are provided by the related ACS 2016 estimates. Note that the ACS 2016 1-year estimates are for the calendar year 2016. From these data we can get the following migration detail … In 2016, there were an estimated 605,018 people who moved from a residence 1 year earlier, in a different state, to Florida. Florida experienced the largest number of movers (inflows) from other states among all states. 60,472 of these movers were from New York. See the interactive table in this section to examine similar characteristics for any state. These data are based on the 2016 ACS 1 year estimates. See about related data.

The American Community Survey (ACS) asks respondents age 1 year and over whether they lived in the same residence 1 year ago. For people who lived in a different residence, the location of their previous residence is collected. The state-to-state migration flows are created from tabulations of the current state (including the District of Columbia) of residence crossed by state of residence 1 year ago.

Movers Within and Between States & Selected Areas During 2016
Use the interactive table to examine state outmigration by destination state. View, compare, query, rank and export data of interest.

Data Analytics Web Sessions
.. is my area urban, rural or …
.. how do census blocks relate to congressional district? redistricting?
.. how can I map census block demographics?
Join me in a Data Analytics Web Session, every Tuesday, where we review access to and use of data, tools and methods relating to GeoStatistical Data Analytics Learning. We review current topical issues and data — and how you can access/use tools/data to meet your needs/interests.

About the Author
Warren Glimpse is former senior Census Bureau statistician responsible for innovative data access and use operations. He is also the former associate director of the U.S. Office of Federal Statistical Policy and Standards for data access and use. He has more than 20 years of experience in the private sector developing data resources and tools for integration and analysis of geographic, demographic, economic and business data. Contact Warren. Join Warren on LinkedIn.

Census Block, Block Group & Census Tract GeoDemographics

Census tracts, block groups and blocks are the important small area statistical geographic areas for which data from Census 2010 are tabulated. Data for census tracts and block groups are also tabulated annually from the American Community Survey. For example. in December 2018, we will have new “richer demographics” annual estimates centric to each year 2008 through 2015 for Census 2010 tracts and block groups … data such as educational attainment, language spoken, housing and household characteristics,  income characteristics and employment and other demographic-economic attributes.

Largest Population New York City (NYC) Census Blocks
The following graphic shows the NYC Census 2010 census block having the largest Census 2010 population that is not a group quarters population block. The Lincoln Center census block shown in the graphic (red boundary) has 4,067 population and 2,922 housing units.

– click graphic for larger view; view developed using CV XE GIS

This block (36 061 015500 6000) occupies 0.033 square miles. It has a population density of 122,333 (population per square mile). The NYC block with the largest population is on Rikers Island and has a group quarters population of 8,634 and 0 housing units. For Census 2010, there were 350,169 census blocks covering the state of New York; 13,356 census blocks were water blocks. For the State of New York, as of Census 2010 the average census block population was 55 (57 excluding water blocks).

Census 2010 and Census 2020
These geographies have generally stable geographic areas and codes from one decennial census (e.g., Census 2010) to the next (e.g., Census 2020). Many of these areas will change in terms of code and area for Census 2020, though the geographic changes will typically be small or not at all.

Census 2020 block, block group and tract codes and geometry will be available in late 2020. Initial block level demographics will be available in March 2021.

Census 2010 & Current GeoDemographics
These areas cover the U.S. from wall-to-wall and generally non-changing in terms of boundary and geographic code (geocode) until Census 2020. This section provides a summary of new Web pages with more detail about each of these geographies:
census tracts and tract codes .. 73,056 areas
census block groups and block group codes .. 217,740 areas
census blocks and block codes .. 11,078,297 areas

Each of these pages provides an interactive table to view tallies of Census 2010 for each of these small area geographies.

Combining Address Data with Small Area Geography
The address of the Office of the California Secretary of State, located at 1500 11th St, Sacramento, CA 95814, was geocoded using the APIGeocoder and converted into a shapefile for Geographic Information System applications.  The location is shown as a red marker in the map views shown below, illustrating each type of small area geography: tracts. block groups and blocks.

Census Tracts
Tracts are labeled with green tract codes. Address 1500 11th St, Sacramento, CA 95814 is shown by red marker.  The address is in tract 06067001101.

View created using CV XE GIS.

Block Groups
Block groups are labeled with red block group codes.  Tract 06067001101 is comprised of block groups: 060670011011 and 060670011012.  See pointer in map view; the block group within tract boundary.

View created using CV XE GIS.

Zoom-in to Census Block
Blocks are labeled with yellow block codes. The address is located in block 060670011011085.

View created using CV XE GIS.

Further Zoom-in Showing Streets
Streets are labeled with street names. Identify tool is used to show mini-profile for 1500 block of 11th Street.

View created using CV XE GIS.

Is the tract code 11.01 or 001101?
Both. Census tracts within a county are identified by a 4-digit basic code between 0001 and 9999, and may have a 2-digit suffix ranging from .01 to .98; for example, 6059.02. The decimal point separating the 4-digit basic tract code from the 2-digit suffix is shown in Census Bureau printed reports and maps. For geo-referencing, the decimal point is implied and does not appear; the 6-character tract code with lead zeroes is used — a character string with no blanks and all numbers.

Accessing and Using these Geographies & Related Demographics
There are several ways these geographies can be used.
• The geocodes are the “handles” to access demographic-economic statistical data.
• The geographies may be visually, geospatially, related as shapefiles.
.. the Census Bureau makes these shapefiles available for use in user appications.
.. the shapefiles typically do not include demographic-economic data.

Access Census 2010 Census Block (and Block Group/Tract) data:
• P.L. 94-171 Redistricting Data — http://proximityone.com/cen2010_pl94171.htm
• Summary File 1 — http://proximityone.com/cen2010_sf1.htm

Access Census Block Group and Tract richer demographics:
• 2016 American Community Survey (ACS) 5-year estimates
  — http://proximityone.com/acs1216.htm
• Access annual counterparts to above section
• Census blocks — http://proximityone.com/cenblk.htm
• Census block groups — http://proximityone.com/blockgroups.htm
• Census tracts — http://proximityone.com/tracts.htm

Alternatively use the Census Bureau APIs or CV XE GIS APIGateway.

Data Analytics Web Sessions
.. is my area urban, rural or …
.. how do census blocks relate to congressional district? redistricting?
.. how can I map census block demographics?
Join me in a Data Analytics Web Session, every Tuesday, where we review access to and use of data, tools and methods relating to GeoStatistical Data Analytics Learning. We review current topical issues and data — and how you can access/use tools/data to meet your needs/interests.

About the Author
Warren Glimpse is former senior Census Bureau statistician responsible for innovative data access and use operations. He is also the former associate director of the U.S. Office of Federal Statistical Policy and Standards for data access and use. He has more than 20 years of experience in the private sector developing data resources and tools for integration and analysis of geographic, demographic, economic and business data. Contact Warren. Join Warren on LinkedIn.

How America’s Cities are Changing

… tools, data and insights into how America’s cities are changing, 2010-to 2017.  Of the nation’s 325.7 million people, an estimated 205.0 million (62.9%) live within an incorporated place as of July 1, 2017. Of approximately 19,500 incorporated places, about 76 percent had fewer than 5,000 people and nearly 50 percent had fewer than 1,000 people. Examine characteristics of individual city population trends and compare cities in states, regions and peer groups using the interactive table in this related section. See three related static tables below showing characteristics the 15 largest cities. Use the U.S. by cities shapefile with your GIS projects. See related GIS & mapping details. See more about the sources and uses of these data in this related section.

Mapping America’s 15 Largest Cities
The following view shows cities with 2017 population of 874,000 or more in blue. Labels show rank among all cities based on 2017 population. These 15 cities have a total 2017 population of 30.6 million of the 205 million total population in all U.S. cities (15%). Click graphic for larger view; expand window to full screen.
… click links in Table 3 below to view maps of these cities.

– View developed using the CV XE GIS software.

Patterns of City Percent Change in Population 2010-17
— Cities in the Los Angeles Area
The following view shows thematic patterns of population percent change, 2010-17 for cities in the Los Angeles, CA area. See color/interval assignment in legend. Click graphic for larger view; expand window to full screen. Larger view shows city names and 2017 population.

– View developed using the CV XE GIS software.
– Flexibly create your own views using the cities GIS project.
– Examine city population trends, patterns; zoom to desired areas; label as needed; integrate other data.

Tables Showing the Largest 15 cities
Data/characteristics shown in the following static tables may also be viewed in the interactive table above with more flexibility and details.

Table 1. 15 Cities With the Largest Numeric Increase, 7/1/16-7/1/17
.. cities with populations of 50,000 or more in 2016

Table 2. 15 Fastest-Growing Large Cities, 7/1/16-7/1/17
.. having populations of 50,000 or more in 2016

Table 3. 15 Most Populous Cities as of July 1, 2017
These 15 cities have a total 2017 population of 30.6 million of the 205 million total population in all U.S. cities (15%).

Mapping & GeoSpatial Analysis of the Largest 15 Cities
Click link in the list below to view map of city shown in the above table.
1 New York
2 Los Angeles
3 Chicago
4 Houston
5 Phoenix
6 Philadelphia
7 San Antonio
8 San Diego
9 Dallas
10 San Jose
11 Austin
12 Jacksonville
13 San Francisco
14 Columbus
15 Fort Worth

City/Place Demographics in Context & Related Data
• State & Regional Demographic-Economic Characteristics & Patterns
.. individual state sections with analytical tools & data access to block level
• Metropolitan Area Situation & Outlook
.. continuously updated characteristics, patterns & trends for each/all metros
• ACS 2016 5-year estimates
.. related City/Place Demographic-Economic Interactive Tables
.. General Demographics … Social … Economic … Housing Characteristics
• Corresponding U.S. by County 2010-2017 Estimates

Data Analytics Web Sessions
Join me in a Data Analytics Web Session, every Tuesday, where we review access to and use of data, tools and methods relating to GeoStatistical Data Analytics Learning. We review current topical issues and data — and how you can access/use tools/data to meet your needs/interests.

About the Author
Warren Glimpse is former senior Census Bureau statistician responsible for innovative data access and use operations. He is also the former associate director of the U.S. Office of Federal Statistical Policy and Standards for data access and use. He has more than 20 years of experience in the private sector developing data resources and tools for integration and analysis of geographic, demographic, economic and business data. Contact Warren. Join Warren on LinkedIn.

School District Revenue & Expenditure Patterns, FY 2016

.. many school districts are adopting 4-day school weeks.  Part of the reason is shortage of funds.  The amount spent per student for public elementary-secondary education for all 50 states and D.C. increased by 3.2 percent to $11,762 during the 2016 fiscal year, based on new data from the Census Bureau released May 21, 2018. The increase in spending in 2016 was due in part to the increase in revenue across all 50 states and D.C. In 2016, public elementary-secondary education revenue, from all sources, amounted to $670.9 billion, up 4.6 percent from the prior year. This is the largest increase since 2007. Yet for many districts this is not enough.

This section provides access to tools and data to to examine K-12 school district finances — sources and uses of funds for FY 2016. The Census Bureau collects these data annually to meet to needs of the National Center for Education Statistics. ProximityOne restructures and integrates these data with other data for GIS/geospatial analysis using the CV XE GIS tools and School District GeoDemographic Information System (SDGIS).

View annual school district finances Web sections: FY 2014 .. FY 2015 .. FY 2016
• Use interactive table to examine school system finances
• Create/view profile for a district(s) of interest.

Current Spending per Student by School District, FY 2016
The following graphic shows patterns of current spending per student by school district, FY 2016, for Texas and adjacent areas. The four largest Texas metros are shown with the bold brown boundary; counties with gray boundaries. Color/fill patterns and corresponding values are shown in the inset legend. Click graphic for larger view showing a partial mini-profile for Houston ISD (at pointer in map).

– view developed using the CV XE GIS analytical tools.
– use these tools on your computer to examine these data & related geography/subject matter.

Data Analytics Web Sessions
Join me in a Data Analytics Web Session, every Tuesday, where we review access to and use of data, tools and methods relating to GeoStatistical Data Analytics Learning. We review current topical issues and data — and how you can access/use tools/data to meet your needs/interests.

About the Author
Warren Glimpse is former senior Census Bureau statistician responsible for innovative data access and use operations. He is also the former associate director of the U.S. Office of Federal Statistical Policy and Standards for data access and use. He has more than 20 years of experience in the private sector developing data resources and tools for integration and analysis of geographic, demographic, economic and business data. Contact Warren. Join Warren on LinkedIn.
 

Metropolitan Area New Residential Construction in 2017

.. understanding the housing situation; examining housing supply and demand market conditions; assessing trends for metropolitan areas … and how metros of interest are changing .. tools and data to examine patterns and change.

During 2017, cities and counties in permit issuing places authorized the construction of 1,281,977 new privately owned housing units with a total valuation of $258.5 billion. This was 1.4 percent above the annual estimate of 1,264,051 housing units and is a 6.2 percent increase from the 2016 total of 1,206,642.

Patterns of New Residential Construction by Metropolitan Area
The following graphic shows the 20 largest metropolitan statistical areas (MSAs) based on the number of new residential housing units authorized in 2017. Click graphic for larger view showing MSAs labeled with rank and name.

View created with CV XE GIS. Click graphic for larger view.

Residential Construction Data Analytics — Using Tools & Data
Visit the related Web section to access interactive table and GIS/GeoSpatial analytical tools and data.

Data Analytics Web Sessions
Join me in a Data Analytics Web Session, every Tuesday, where we review access to and use of data, tools and methods relating to GeoStatistical Data Analytics Learning. We review current topical issues and data — and how you can access/use tools/data to meet your needs/interests.

About the Author
Warren Glimpse is former senior Census Bureau statistician responsible for innovative data access and use operations. He is also the former associate director of the U.S. Office of Federal Statistical Policy and Standards for data access and use. He has more than 20 years of experience in the private sector developing data resources and tools for integration and analysis of geographic, demographic, economic and business data. Contact Warren. Join Warren on LinkedIn.
 

Insights into County/Metro Business Establishment Patterns

.. new data, released this past week, enable us to better assess county and metro business establishment patterns .. these data help businesses understand how sales of their products and services align with markets .. what counties might be underserved? .. where should marketing and sales operations be ramped up or reduced in scope/reallocated? .. what do these tell us us about organization of market territories? how are these characteristics trending by county? Use the this interactive table to examine business establishments characteristics by county and metro by type of business. See more detail in the related Web section about topics covered in this post. 

• U.S. establishments rose 1.2% from 7,663,938 in 2015 to 7,759,807 in 2016.
• First quarter employment was up 2.1% from 124,085,947 to 126,752,238
• Annual payroll was up 2.9% from $6.3 trillion in 2015 to $6.4 trillion in 2016.

Based on the 2016 data (new April 2018), there are 7.3 million establishments in Metropolitan Statistical Areas (MSAs). In these MSAs ..
• 5.3 million establishments have fewer than 10 employees.
• 6,522 of these establishments have 1,000 or more employees.
• 374 of these establishments have 5,000 or more employees.

MSAs by Number of Establishments with 1,000 or more Employees
The following graphic shows Metropolitan Statistical Areas (MSAs) by number of establishments with 1,000 or more employees. Click graphic for larger view view showing metros labeled with number of these establishments. Expand brower to full window for best quality view.
.. View developed with CV XE GIS software and related GIS project.

Business Establishment Characteristics Updated in Metro Reports
Examine 2014, 2015, 2016 mini trend profiles for establishments by 2-digit sector in Metro Situation & Outlook Reports Choose any MSA by clicking column 3 in this table .. then view section 6.3. Examples:
New York .. Los Angeles .. Miami .. Chicago .. Dallas .. Houston .. Denver .. Seattle

Gaining Insights
Gain insights into these types of patterns by county by detailed type of business (NAICS). Use the interactive table below to examine business establishment characteristics for counties and metros of interest. Data reviewed in this section are based on the Census-sourced County Business Patterns released in April 2018. We have integrated current population estimates with the establishment data in the interactive table.

Tools You Can Use
• create maps and geospatially analyze business establishments at 6-digit industry detail with ready-to-use GIS project/tools .. see related section for details.
• Use the APIGateway tools to build custom business establishment datasets.
• Use the interactive table to query/view sort business establishment characteristics by county and metro.

Data Analytics Web Sessions
Join me in a Data Analytics Web Session, every Tuesday, where we review access to and use of data, tools and methods relating to GeoStatistical Data Analytics Learning. We review current topical issues and data — and how you can access/use tools/data to meet your needs/interests.

About the Author
Warren Glimpse is former senior Census Bureau statistician responsible for innovative data access and use operations. He is also the former associate director of the U.S. Office of Federal Statistical Policy and Standards for data access and use. He has more than 20 years of experience in the private sector developing data resources and tools for integration and analysis of geographic, demographic, economic and business data. Contact Warren. Join Warren on LinkedIn.

Location-Based Demographics Update

.. tools you can use to examine characteristics of addresses/locations .. many of us are interested in knowing attributes of addresses or locations. Often knowing address latitude-longitude is important so that the addresses can be viewed on a map .. see below.  Some might need to know what census block, or other geography, in which an address is located .. or what school district is an address located in.  Others need to know demographic-economic attributes of the neighborhood or area where an address is located.  These types of attributes can be obtained for addresses using the Location-Based Demographic (LBD) tools.  The LBD tool has just been made a part of the CV XE GIS software.  The LBD tool is available in all versions of CV XE GIS, including the no fee User Group version. See more about using the LBD tools to look-up and analyze address/location attributes.

Viewing Geocoded Addresses on a Map – automatically
The following view shows addresses geocoded using the LBD tool. Markers show addresses of 27 Trader Joe’s locations in the Los Angeles area. LBD automatically creates a shapefile that is added to your GIS project. The markers are labeled with population ages 18 and over in the corresponding census tract. Marker color/styles reflect different levels of median household income. A separate census tract layer shows patterns of economic prosperity.

Click graphic for larger view. Expand browser window. A mini profile is displayed showing demographic-economic attributes for the marker at pointer.

View the locations without the tract thematic pattern layer:

Make similar views for your addresses.

Get Started Using the LBD Tool
1 – join the User Group .. click here to join (no fee).
2 – run the installer to install on a Windows machine .. requires your userid.
3 – with CV XE GIS running, click Tools>Find Address/LBD
    enter an address .. a form appears showing characteristics of the address.
4 – see more about using the tools on the LDB page.

GeoStatistical Data Analytics Learning Sessions
We are developing a series of “GeoStatistical Data Analytics” (GSDA) Learning Sessions/modules. One of these is focused on using the LBD tools and methods in the broader context of data analytics. We plan to develop the GSDA models for self-guided use by analysts/practitioners as well as in the classroom setting with teacher/student materials. Upcoming blog posts will describe the program in more detail.

Data Analytics Web Sessions
Join me in a Data Analytics Web Session, every Tuesday, where we review access to and use of data, tools and methods relating to GeoStatistical Data Analytics Learning. We review current topical issues and data — and how you can access/use tools/data to meet your needs/interests.

About the Author
Warren Glimpse is former senior Census Bureau statistician responsible for innovative data access and use operations. He is also the former associate director of the U.S. Office of Federal Statistical Policy and Standards for data access and use. He has more than 20 years of experience in the private sector developing data resources and tools for integration and analysis of geographic, demographic, economic and business data. Contact Warren. Join Warren on LinkedIn.