MGM2 Home Definition of terms Economic impacts inquiry Methods

Methods
Introduction
Inputs
Source of Errors & Limitations
Validation
State Tourism Websites

Introduction

Economic impact estimates for National Park Service (NPS) units were produced using the Money Generation Model 2 (MGM2). The estimates are based on recreation visits at each park, NPS visitor spending averages, and regional economic multipliers. Economic impacts are measured as the direct and secondary effects on the local economy in terms of sales, personal income, jobs and value added. For detailed information regarding the MGM2 model, see the MGM2 user manual. The NPS 2001 system wide report includes a more extensive discussion of the interpretation of the economic impact estimates and model assumptions and limitations.

Top

Model Inputs

Three major inputs to the MGM2 model are:

1. Number and types (segments) of visitors to the local region.
2. Average spending in the local area for each segment on a per party per day basis
3. Multipliers and economic ratios for the local region around the park

The MGM2 model also requires estimates of party sizes, length of stay in the area, and park re-entry rates for each visitor segment, These are used to convert NPS estimates of recreation visits to the number of party days/nights spent by park visitors in the local area. Party days/nights = (recreation visits * length of stay)/(party size * park entries per trip). Visitor spending is estimated by multiplying the number of party nights by an average level of spending per party per night for each segment. Spending is itemized into 12 distinct categories to facilitate bridging of spending into specific economic sectors. Spending is then applied to a set of economic ratios and multipliers for these sectors that represent the local region's economy.

Few parks have a complete set of all input data. The only inputs available consistently across all park units are recreation visits and overnight stays in the park. Other inputs for each park are determined by a combination of visitor survey data, generalizing from estimates at similar parks, and in some cases manager judgment.

Three distinct approaches characterize the level of detail and sources of the MGM2 input data:

§ Full MGM2 Model - Parks with recent visitor surveys including spending data
Sixteen park units have conducted visitor surveys that included spending information during the past four years. For these parks, the full MGM2 model was used with up to eight distinct visitor segments. Visitor segment shares, visit conversion factors and spending averages were generated directly from the VSP raw data sets. In cases where IMPLAN data files were available for the counties around the park, multipliers specific to the local region were used. In other cases, the MGM2 generic multipliers were selected based on the characteristics of the surrounding region.

§ MGM2 Shortform - By type of park and manager inputs
For another sixty park units, the short form of the MGM2 model was used to estimate impacts for 2001.. The shortform includes four segments (local, day trip, motel, and camp). Park managers were contacted and asked to estimate the key MGM2 inputs for their park. These figures were compared with those for similar parks and our own judgment. Some validation of results has been carried out by comparing segment share estimates with park overnight stay data and other lodging opportunities in the area. In some cases local room taxes, lodging sales figures, and general area tourism visit and economic data were available for comparisons.

§ MGM2 Shortform - By type of park
For parks lacking recent visitor surveys and particularly for smaller park units with low visitation levels, sets of default input parameters were established based on the more complete data at other parks. Parks were classified based on general type (historic sites vs natural resource based parks), regional settings (large urban area, smaller cities, rural), and spending opportunities (high, medium and low spending areas). Visit conversion parameters, segment shares, visitor spending averages, and choice of multipliers were made for each park based on these classifications.

A dozen parks with recent VSP studies, representing a range of park types and regional differences, were selected to generate several input parameters for the MGM2 model starting in 2001. These parameters included average party size, length of stay in the region, park re-entry rate, visitor types by lodging segments and spending profiles. Based on the characteristics of parks, three generic spending profiles (high, medium and low) and two sets of visitor segment shares (natural resource parks vs. historical sites) were constructed. Local area multipliers are based on input-output models, estimated from the IMPLAN system. Four sets of generic multipliers by regions (rural, small metro, big metro, and state level) are provided. Estimates for 2003 were obtained by price adjusting the spending profiles from 2001 to 2003 and updating the visit estimates.

Top

Sources of Error and Study Limitations

Accuracy of the MGM2 estimates depends mainly on the accuracy of the three inputs:

(1) the number and types of visitors,
(2) spending averages and
(3) economic multipliers

-- roughly in this same order of importance.

The official NPS Public Use Statistics are the basis for visit estimates. Errors may be introduced in adjusting recreation visit figures for park re-entries and converting visits from a person to a party basis. The NPS visitation reporting system measures entries to a national park, not days/nights spent in the area or the number of distinct visitors or trips. For some parks, visitors may be counted multiple times during a stay in the area. Limited information is available for most parks to estimate re-entry factors or length of stay in the area.

Many parks also lack accurate information to estimate the percentage of visitors who are local, on day trips or staying overnight outside the park. Estimates of segment shares for parks with recent visitor surveys are likely more accurate than those based on manager judgment. or figures at similar parks. Where recent visitor surveys exist, segment share estimates are prone to errors due to non-response, sampling locations and dates, and length of stay bias. Local residents are often under-represented in visitors surveys due to all three of these factors. Overnight visitors and especially those camping in developed campgrounds inside the park tend to be over-represented, based on comparisons of survey results with park overnight stay data. Backcountry campers also tend to be under-represented. VSP studies typically are conducted during a 1-2 week period, which can introduce significant seasonal biases in the results. Some adjustments for these potential biases were made in our analysis of VSP study data.

Spending averages are estimated for four primary visitor segments (local day trips, non-local day trips, overnight stays in motels, overnight stays in campgrounds) that help explain variations in spending. Sampling errors (95% confidence interval) for spending averages estimated in park visitor surveys generally are around 5% overall and 7-20% for individual segments. In applying the spending averages to different parks, the issue is one of generalizability of spending figures from one park or situation to another rather than sampling error. It is difficult to estimate the potential generalization errors, although comparisons of spending averages within segments across different parks, indicates that segment shares capture much of the variation in spending. This supports the basic assumption of the MGM2 model that spending profiles of individual segments are more readily applied across parks than an overall visitor spending average.

Multipliers mainly affect the estimates of secondary effects. In most cases, the regional multipliers for tourism-related sectors can be predicted quite accurately based on the population of the area. Use of MGM2 generic multipliers, which are grounded in input-output models estimated with the IMPLAN system, does not appear to introduce significant errors. It should be noted, however, that the MGM2 multipliers are considerably lower than exaggerated multipliers that are in fairly widespread use within recreation and tourism. Many analysts are using outdated, statewide, non-recreation and other available multipliers inappropriately to estimate local economic impacts of recreation spending. MGM2 Type II sales multipliers generally range from 1.3 for rural areas to 1.6 for statewide regions or metropolitan areas.

Perhaps the greatest source of variations across published studies and economic impact figures involves decisions about which visitors and spending should be attributed to the park. MGM2 estimates will be conservative in that we only include spending in the local area and do not attempt to capture spending that would not be lost to the region in the absence of the park. For many areas, however, identifying which trips of spending would be lost to the area requires a more complete understanding of visitor motivations and behavior.

Economic impact analysis measures the changes in economic activity resulting from some action. Analysts generally prefer a "with vs without" analysis that sorts out what spending would be lost to the region in the absence of the proposed action. The action being evaluated in the park impact estimates reported here is the closure or unavailability of a given national park to visitors. It is difficult, however, to isolate which trips to the area and spending would not occur in the absence of the park. Many visitors come to the region for a combination of attractions, facilities, activities and events, some on business or to visit friends or relatives. In our approach, only the additional expenses for a park visit is counted if the trip to the area is primarily for other reasons, be it visiting friends/relatives, staying at a seasonal home, or visiting another attraction. Trip purpose information, however, is only available for parks with recent visitor surveys that have asked these questions.

Spending by visitors who live in the local area is normally excluded in an impact analysis, on the grounds the spending would not be lost in the absence of the park. Inclusion of local resident spending depends on whether the substitute for the park visit is a different local activity or a trip outside the region. The MGM2 results include local visitor spending, assuming more trips would be made outside the local area if the park were unavailable. As locals are treated as a distinct segment in the MGM2 model, their contribution to spending is readily subtracted, if desired.

Impacts provided here only cover spending by park visitors in the local region and exclude park entry fees paid to the NPS. The economic impacts of park payroll, operations and construction on the local economy may be estimated using MGM2Operate.xls. MGM2 only includes spending that occurs within the local region, typically defined by a 30-100 mile radius depending on the park type and regional characteristics.

Finally, the MGM2 impact estimates are based on regional input-output (I-O) models, and are therefore subject to the general limitations of
I-O models. In particular, the model is linear so a doubling of spending or sales in a given sector will double jobs, income and value added -- the model does not take into account any economies or diseconomies of scale. Firms in a given industry are assumed to use a common production function (the national average). One must also assume that the categories in which visitors report spending are correctly matched with the sector producing the given commodity in order to properly represent the production function. Production functions of smaller firms in rural areas can differ considerably from national averages and many goods and services purchased by visitors do not fit neatly into standard economic sectors. Campgrounds and B&B's, for example, are grouped with hotels, and the amusements sector is a catch-all for a host of distinct types of firms. Nevertheless, I-O models have proven to be fairly robust, and errors due to the I-O part of the MGM2 model are generally small relative to the visit and spending pieces.

Top

Validation

An alternative approach to validating the MGM2 estimates is through comparisons with other studies and sources of information. Where available, we recommend comparing the MGM2 estimates of visitors, room nights, campsite nights, and spending with general tourism statistics for the region. The share of activity from park visitors should be reasonable. Estimates of room and campsite nights can also be compared with NPS overnight stay figures, after dividing them by an average party size. Based on the number of rooms and campsites inside vs outside the park and some knowledge of visitor use patterns, the percentage of room and campsite nights by park visitors provided by the NPS should be reasonable. Surveys asking park visitors who stay overnight in the area whether they are staying inside or outside the park can further validate the estimates of park visitors staying overnight in the area.

Spending averages can be compared with other recent/local surveys. Keep in mind that spending patterns of park visitors may not be the same as general tourists to the area. With spending expressed on a per party night basis, the average room or campsite rate can be compared with local rates (be sure to take into account discounts and off-season rates). Appendix D of the MGM2 manual provides tips for estimating visitor spending averages using an engineering approach.

MGM2 estimates of sales, income and jobs in hotels and restaurants can be compared with local economic data. Park visitors should not account for more than 100% of sales in a given area. The ratio of park visitor restaurant spending to local restaurant receipts should be reasonable given the ratio of tourists to local residents and the portion of tourists who are park visitors.

Local and state tourism organizations are good sources of information and potential partners in assessing economic impacts of park visitors or tourists to an area. Many state tourism offices have statistics for local area. Check your state to see if county or regional level tourism statistics are available. We have compiled a list of state tourism offices including links to research/economic sections, when available.

Top

Last Update: May 5, 2003