• Select the audiences for the data. Using a few simple tools such as FMC’s Audience Exercise found in the Resource Library to choose a few stakeholders in each season that you want to influence or keep engaged. Add new ones each season.
• Collect as little data as possible. This seems counterintuitive, but many markets exhaust their team by collecting too much data that they never use! Or, some market stakeholders forget that the market is not a laboratory but an actual mercantile space that needs to operate as smoothly as possible. Remember that every piece of data you collect will need to be checked (probably by you) for accuracy and relevance, so the less added work, the better.
• Start with the simple data. Any data point that requires complete collection (like vendor sales) or advanced calculations (like figuring out the average sale per shopper) should be added in later seasons and not at the start of a data collection phase.
• Use the data again and again. For each data point (metric) that you gather, use it often on social media, in your email signature, on chalkboards, shared with vendors.
• Always consider the amount of time and staffing required to collect, enter, analyze, AND to use the data.

​​

OVERVIEW OF DATA COLLECTION TOOLS

Developed for FMC by consultants Amanda Edmonds and Lindsay Way in collaboration with Dar Wolnik, FMC Evaluation Manager and Diana Broadaway, FMPP Project Manager

Farmers Market Coalition has created this free set of Data Collection Tools for farmers markets and market partners and to use and adapt as needed. Each tool is available in in MS Word document (for customizing or extracting from), and Google form (for use in electronic forms and surveys). Even if you do not need a tool in its entirety, you may want to  add questions from them to your vendor application, customer survey, or membership application.

FARMERS MARKET QUESTION BANK

The Farmers Market Coalition Evaluation Question Bank is a set of standardized question designed for use by farmers markets and statewide networks and organizations.  This resource can make it easier for markets to evaluate themselves, as well as help the farmers market sector with developing shared metrics.  By doing so, groups of markets– at the local, regional, state, and national level– can understand their collective trends and impact.  Questions can be extracted from this spreadsheet and included in your organization’s forms, surveys, or other workflows.  You can extract as few or as many questions.  In this spreadsheet format, you can sort the questions by metric, level (vendor, visitor,  market location, market organization, et al).  Alternatively, there are completed Collection Tools that you can download and use in full or edit as needed.  They are available in pdf, editable MS Word document, and google forms versions.

FMCEvaluationQuestionBank (excel)

Data Collection Tips

We recommend conducting evaluation activities 2 – 4 days per season to collect a representative sample of data. Here is an example of how to schedule them: Here is an example of how to schedule the different data collection efforts for a market:

• Visitor Counting Days: On the 4th, 10th, 16th, and 22nd market days of the season
• Visitor or Vendor Surveys: On the 4th, 10th, 16th, and 22nd market days of the season
• Other Observation: On the 6th, 12th, 18th, and 24th market days of the season
• If two seasons of data collection are needed, repeat for each season.

Tips for Successful Data Collection Days

Collecting data either via an online form that anyone can access from their phone or tablet or it can be collected on slips of paper. The latter will require someone to do the data entry once all are collected and checked.
Find templates at https://farmersmarketmetrics.guide/resources/ under Data Collection Methods.

Some general tips about data collection day(s):

Assign one person as Survey Leader. That should not be the market manager if at all possible. That person will manage the team, collect completed surveys and check the tallies throughout the day. Explain the day’s breakdown, including where everyone is to be at what time. Keep water and extra supplies and chairs for between shifts. Have everyone introduce himself or herself.
If there is time, do one or two rounds of role-playing with the survey leader acting as the data collector.
Assure the collectors that this will go well and be easy work. Offer some sample language for intercept or dot surveys, such as “Do you have a minute to help the market?” and give a simple explanation to use when questioned by visitors or vendors, such as, “We’re gathering information to help the market.”

When handing the collectors their interview or observation sheets, mark their name and goal for completion for that hour on the top sheet or a post-it note. Then, ask them to come back to the booth or arrange to meet them at a specified time at the end of that time period. All collectors should have 5 minutes as needed for a break or a 20-30 minute break for those collectors working the entire market day. Make sure the Survey Leader has all of the team’s mobile numbers; you’d be surprised at how hard it can be to spot a volunteer.

Give everyone the name and phone number for the survey leader to call if they have an issue, even if that person will be checking with them regularly. If possible, also introduce each collector or counter to the vendor nearest to their station.

At the end of their first collection, ask collectors how things went, ask them to describe one of their data collections, and ask them for any ideas to make it easier or more fluid the next time.

Analysis of the Data

Analysis is the process of identifying patterns and correlations within the raw data and then translating it into usable information. Analysis can answer some important questions like “How is this market benefiting vendors?” or “How are attitudes, behaviors, and knowledge changing because of the market?”

The approach to data analysis may vary, depending on who is leading the research effort. Like everything else about a farmers market, a collaborative and open process works best. The responsibility can be shared with university researchers, other markets, or municipal or agency partners. When working with partners, markets should still retain ownership of their raw data and ask for author credit for all analysis and reporting or, at a minimum, be acknowledged as a full partner.

Make sure that the analysis is appropriate and will not skew later data collection efforts. For example, taking a tally of visitors only on special event days may mean the analysis inflates the actual number of visitors over a season. Or vendor data does not include a large portion of the vendor base, meaning that the data is not really representative. When there is less data, there may still be a way to use it to report, with a case study approach (“On the first market day of the year, prepared food vendors reported a 25% increase in sales over the year before.”)

National Farmers Market Week

Please share your data reports with FMC and upload your evaluation best practices to the FMC Resource Library for your peers to use for their evaluation plan.

.