data.gov<\/a>. (If, for some reason, you wish to use a data source not on this page, please clear it with me first). The data source you choose must have either a CSV or JSON format available.<\/p>\n(Hint: if you don’t want to spend a lot of time going through data files looking for a good one, you’re welcome to use the file 2010-census-by-zip-simplified.csv on T-Square in the resources folder. It’s a version of the 2010 census data linked off of data.gov, but with spaces removed from the field names to make the assignment a bit simpler.<\/em><\/p>\nAnother hint: working with CVS data files will generally be a bit easier than working with JSON data files, but you can pick whichever you’d like.)<\/em><\/p>\nYou can think of these data files as representing tabular data, encoded into either CSV or JSON format. The table consists of multiple fields, <\/em>which you can think of as columns. Each entry<\/em> expresses the relations among a set of fields, which you can think of as being the rows in the table. While JSON data is potentially a bit more complex than this conceptually, most of the data sets at data.gov still basically represent tabular data. You must pick a data source that has at least four fields in it and at least 10 rows.<\/p>\nYour code must load the data you’ve chosen, and then support a variety of queries that can be typed in at the command line by a user. You can hard-code the reference to your data file, but please set up your code so that it expects the data file to be in the same folder as your Python code (and so references it using just the base filename), and doesn’t contain any platform-specific path characters. I should be able to copy your code and data file to my computer and run it without problem. For reading user input from the command line, you’ll want to use raw_input() or one of its variants.<\/p>\n
The queries you should support are:<\/p>\n
\n- max <field><\/strong>: given a particular field name<\/em>, find and print the data that has the maximum<\/em> value for this field across your entire data set.<\/li>\n
- min <field><\/strong>: given a particular field name<\/em>, find and print the data that has the minimum<\/em> value for this field.<\/li>\n
- avg <field><\/strong>: given a field name<\/em>, compute the average of all values in your data for this field. (You can assume this will only be called on fields that have numeric values.)<\/li>\n
- search <field> <value><\/strong>: find all data in your dataset for which the named field<\/em> has the indicated value.<\/em><\/li>\n
- range <field> <min> <max><\/strong>: find all data in your dataset for which the named field <\/em>has values between the specified min <\/em>and max<\/em>, and display in ascending order.<\/li>\n
- quit: <\/strong>exit the program.<\/li>\n<\/ul>\n
In essence, these commands make up a simple command language that will allow your user to explore the data. When these commands are entered into your program, your code should parse them and execute them correctly.<\/p>\n
(Hint: some of the data will have field names that contain spaces, such as “Total Population.” This will make parsing the commands a bit trickier. For this assignment, if you don’t want to code your program to deal with spaces in your field names, you can either choose a data set that doesn’t have spaces in the field names, or simply edit the data to remove the spaces.)<\/em><\/p>\nHere’s an example interaction, for a table of population estimates from 2013:<\/p>\n
STATE POP_ESTIMATE\nAlabama 4833722\nAlaska 735132\nArizona 6626624\nArkansas 2959373\n\n> min POP_ESTIMATE\n735132\n> max POP_ESTIMATE\n6626624\n> avg POP_ESTIMATE\n3788713\n> search STATE Alaska\nSTATE POP_ESTIMATE\nAlaska 735132\n> range POP_ESTIMATE 2000000 5000000\nSTATE POP_ESTIMATE\nArkansas 2959373\nAlabama 4833722\n\n<\/pre>\nNote that if your data doesn’t lend itself well to these queries, please see me… we can come up with an alternative set that makes more sense for your data.<\/p>\n
To submit your assignment, please create and submit on T-Square a ZIP file that contains the following:<\/p>\n
\n- Your python program<\/li>\n
- The data file you’re using (if this file is larger than a megabyte, please trim it down before submitting… be sure to make sure your program works on this smaller data file before submitting it)<\/li>\n
- A short README.txt file that contains examples of the above queries that produce results using your data file.<\/li>\n<\/ul>\n
EXTRA CREDIT:<\/h5>\n
Up to 10 points for additional sorts of queries, depending on complexity and usefulness.<\/p>\n
<\/p>\n","protected":false},"excerpt":{"rendered":"
Homework 2: Analyzing Structured Data using CSV and JSON Due Date: See class schedule In this assignment you’ll learn how… Read more Homework 2<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-66","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/www.kedwards.com\/cs6452\/wp-json\/wp\/v2\/pages\/66","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.kedwards.com\/cs6452\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.kedwards.com\/cs6452\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.kedwards.com\/cs6452\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.kedwards.com\/cs6452\/wp-json\/wp\/v2\/comments?post=66"}],"version-history":[{"count":10,"href":"https:\/\/www.kedwards.com\/cs6452\/wp-json\/wp\/v2\/pages\/66\/revisions"}],"predecessor-version":[{"id":192,"href":"https:\/\/www.kedwards.com\/cs6452\/wp-json\/wp\/v2\/pages\/66\/revisions\/192"}],"wp:attachment":[{"href":"https:\/\/www.kedwards.com\/cs6452\/wp-json\/wp\/v2\/media?parent=66"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}