Revision history for TagsCleanUpDocumentation2016
Additions:
[[http://wiki.votesmart.org/DatabaseSpecialistDataStandards < Back to the Database Specialist Data Standards]]
Deletions:
Additions:
[[http://wiki.votesmart.org/DatabaseSpecialistDataStandards ,- Back to the Database Specialist Data Standards]]
Additions:
@@Tags Clean-Up
Project End: July 2016@@
**Introduction**
**Project Development**
**Step 1: Research & the Terrible Tags**
**Step 2: Cut-Offs**
**Step 3: The Actual Project Begins**
**Step 4: Categorizing Tags**
**Step 5: Other eyes on ‘tags to be deleted.ods’**
**Step 6: What type of deletion (as you can tell completed much before this step)**
**Step 7: Involving IT**
Mantis ticket = 8037, submitted 8/15/2016, worked on by IT Director Mike Shultz, and completed 8/18/2016.
**Step 8: Project Complete!**
**Final Thoughts on the Project:**
**==Final stats:==**
**Appendix A: Query Used**
**Appendix B: Chart on General Rules**
**Appendix C: Categorization of Tags**
SELECT t.tag_id, t.name, at.sect, count
(t.tag_id) AS count
FROM ((
SELECT ac.tag_id, 'biotext'::text AS sect
FROM ( SELECT biotext_tag.tag_id
FROM biotext_tag
UNION ALL
UNION ALL
UNION ALL
SELECT religion_tag.tag_id
FROM religion_tag
UNION ALL
FROM experience_tag ) ac
UNION ALL
SELECT committee_tag.tag_id, 'committee'::text AS sect
SELECT congcategory_tag.tag_id, 'cong'::text AS sect
FROM congcategory_tag
SELECT measure_tag.tag_id, 'measure'::text AS sect
FROM measure_tag
SELECT npatanswer_tag.tag_id ,'npatanswer'::text AS sect
FROM npatanswer_tag
SELECT rating_tag.tag_id ,'rating'::text AS sect
UNION ALL
SELECT sig_tag.tag_id, 'sig'::text AS sect
UNION ALL
SELECT speech_tag.tag_id, 'speech'::text AS sect
SELECT party_tag.tag_id, 'party'::text AS sect
FROM party_tag) at
JOIN tag t
WHERE t.tag_id IN (86471)
GROUP BY t.tag_id, t.name, at.sect
ORDER BY t.tag_id;
(WHERE t.tag_id IN (t.tag_id1, t.tag_id2, t.tag_id3, t.tag_id4, t.tag_id5, t.tag_id6, t.tag_idn)
Project End: July 2016@@
**Introduction**
**Project Development**
**Step 1: Research & the Terrible Tags**
**Step 2: Cut-Offs**
**Step 3: The Actual Project Begins**
**Step 4: Categorizing Tags**
**Step 5: Other eyes on ‘tags to be deleted.ods’**
**Step 6: What type of deletion (as you can tell completed much before this step)**
**Step 7: Involving IT**
Mantis ticket = 8037, submitted 8/15/2016, worked on by IT Director Mike Shultz, and completed 8/18/2016.
**Step 8: Project Complete!**
**Final Thoughts on the Project:**
**==Final stats:==**
**Appendix A: Query Used**
**Appendix B: Chart on General Rules**
**Appendix C: Categorization of Tags**
SELECT t.tag_id, t.name, at.sect, count
(t.tag_id) AS count
FROM ((
SELECT ac.tag_id, 'biotext'::text AS sect
FROM ( SELECT biotext_tag.tag_id
FROM biotext_tag
UNION ALL
UNION ALL
UNION ALL
SELECT religion_tag.tag_id
FROM religion_tag
UNION ALL
FROM experience_tag ) ac
UNION ALL
SELECT committee_tag.tag_id, 'committee'::text AS sect
SELECT congcategory_tag.tag_id, 'cong'::text AS sect
FROM congcategory_tag
SELECT measure_tag.tag_id, 'measure'::text AS sect
FROM measure_tag
SELECT npatanswer_tag.tag_id ,'npatanswer'::text AS sect
FROM npatanswer_tag
SELECT rating_tag.tag_id ,'rating'::text AS sect
UNION ALL
SELECT sig_tag.tag_id, 'sig'::text AS sect
UNION ALL
SELECT speech_tag.tag_id, 'speech'::text AS sect
SELECT party_tag.tag_id, 'party'::text AS sect
FROM party_tag) at
JOIN tag t
WHERE t.tag_id IN (86471)
GROUP BY t.tag_id, t.name, at.sect
ORDER BY t.tag_id;
(WHERE t.tag_id IN (t.tag_id1, t.tag_id2, t.tag_id3, t.tag_id4, t.tag_id5, t.tag_id6, t.tag_idn)
Deletions:
Project End: mid-July 2016
Introduction
Project Development
Step 1: Research & the Terrible Tags
Step 2: Cut-Offs
Step 3: The Actual Project Begins
Step 4: Categorizing Tags
Step 5: Other eyes on ‘tags to be deleted.ods’
Step 6: What type of deletion (as you can tell completed much before this step)
Step 7: Involving IT
Mantis ticket = 8037, submitted 8/15/2016.
Step 8: Project Complete!
Final Thoughts on the Project:
Final stats:
Appendix A: Query Used
Appendix B: Chart on General Rules
Additions:
||Colleges||College Sports Teams
ex: Penn-State-Nittany-Lions becomes Pennsylvania-State-University||[name]-Month||
||Tribes (Native Americans)||Awards/medals
Becomes awards-and-medals||[name]-Day||
||Reservations (Native Americans)||Churches
Becomes Christianity||Lesser known acronyms||
||Boats (USS-[name])||Random roads/bridges
Becomes roads-bridges-and-highways||[name]-Week||
||Acts on the federal level||[name]-hospitals
Becomes hospitals||Acts on state level||
||Countries||[name]-Fire-Company
Becomes fire-companies||General-[name]||
||Unions||[name]-Watershed
Becomes watersheds||[name]-Township||
||Rivers||[name]-Medical-Center
Becomes medical-centers||[name]-confirmation||
||Political Action Committees||[name]-Newspaper
Becomes newspapers||[name]-nomination||
||Hurricanes||[name]-museum
Becomes museums||small banks||
||Battlefields||[name]-Public-Library
Becomes public-libraries||Dr-[name]||
||Air Force Bases||Ambassador-to-[name]
Becomes [name]-US-relations||Reverend-[name]||
||Naval Bases||[small town]-[state]
Becomes [state]||Rev-[name]||
||Court cases||Port-of-[name]
Becomes ports-harbors-and-waterways||Random irrelevant person's name||
||Pro sports teams||Minor league sports teams
Becomes whatever sport it is||Small towns||
||National Wildlife Refuges||Random committees
Becomes the properly formatted name||Creeks||
||Animals||Random subcommittees
Becomes the properly formatted name||[name]-Task-Force||
||sanctions-on-[name]||Random sporting place
ex: Mile-High-Stadium merges into Denver-Broncos||[name]-Law||
||National forests||[state]-Department-of[name]
Becomes State-Department-of-[name]||Shootings (tagged once)||
||[name]-Party||[name]-fire
Becomes wildfires||Operations||
||[country]-elections||[name]-Courthouse
Becomes courthouses||Mountains||
||I-[#] (interstate tags)||[name]-road/highway/bridge
Becomes roads-bridges-and-highways||||
||Subcommittees||US-[#]
Becomes roads-bridges-and-highways||||
||||[name]-Beach
Becomes beaches||||
||||[name]-State-Park
Becomes state-parks||||
||||[name]-Zoo
Becomes zoos||||
||||[name]-Trail
Becomes recreational-trails||||
||||[name]-Mine
Becomes mines||||
||||[name]-airport (small airports)
Becomes airports||||
||||Random airplane
Becomes airplanes||||
For a complete list of Appendix B with notes, please see research/Active/Department Projects/Database Specialist/Tags Project/Tags Clean-Up Documentation.ods.
ex: Penn-State-Nittany-Lions becomes Pennsylvania-State-University||[name]-Month||
||Tribes (Native Americans)||Awards/medals
Becomes awards-and-medals||[name]-Day||
||Reservations (Native Americans)||Churches
Becomes Christianity||Lesser known acronyms||
||Boats (USS-[name])||Random roads/bridges
Becomes roads-bridges-and-highways||[name]-Week||
||Acts on the federal level||[name]-hospitals
Becomes hospitals||Acts on state level||
||Countries||[name]-Fire-Company
Becomes fire-companies||General-[name]||
||Unions||[name]-Watershed
Becomes watersheds||[name]-Township||
||Rivers||[name]-Medical-Center
Becomes medical-centers||[name]-confirmation||
||Political Action Committees||[name]-Newspaper
Becomes newspapers||[name]-nomination||
||Hurricanes||[name]-museum
Becomes museums||small banks||
||Battlefields||[name]-Public-Library
Becomes public-libraries||Dr-[name]||
||Air Force Bases||Ambassador-to-[name]
Becomes [name]-US-relations||Reverend-[name]||
||Naval Bases||[small town]-[state]
Becomes [state]||Rev-[name]||
||Court cases||Port-of-[name]
Becomes ports-harbors-and-waterways||Random irrelevant person's name||
||Pro sports teams||Minor league sports teams
Becomes whatever sport it is||Small towns||
||National Wildlife Refuges||Random committees
Becomes the properly formatted name||Creeks||
||Animals||Random subcommittees
Becomes the properly formatted name||[name]-Task-Force||
||sanctions-on-[name]||Random sporting place
ex: Mile-High-Stadium merges into Denver-Broncos||[name]-Law||
||National forests||[state]-Department-of[name]
Becomes State-Department-of-[name]||Shootings (tagged once)||
||[name]-Party||[name]-fire
Becomes wildfires||Operations||
||[country]-elections||[name]-Courthouse
Becomes courthouses||Mountains||
||I-[#] (interstate tags)||[name]-road/highway/bridge
Becomes roads-bridges-and-highways||||
||Subcommittees||US-[#]
Becomes roads-bridges-and-highways||||
||||[name]-Beach
Becomes beaches||||
||||[name]-State-Park
Becomes state-parks||||
||||[name]-Zoo
Becomes zoos||||
||||[name]-Trail
Becomes recreational-trails||||
||||[name]-Mine
Becomes mines||||
||||[name]-airport (small airports)
Becomes airports||||
||||Random airplane
Becomes airplanes||||
For a complete list of Appendix B with notes, please see research/Active/Department Projects/Database Specialist/Tags Project/Tags Clean-Up Documentation.ods.
Deletions:
||Tribes (Native Americans)||cell2||cell3||
||Reservations (Native Americans)||cell2||cell3||
||Boats (USS-[name])||cell2||cell3||
||Acts on the federal level||cell2||cell3||
||Countries||cell2||cell3||
||Unions||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
Additions:
Appendix B: Chart on General Rules
|=|Tags Generally Kept
*Unless misspelled|=|Tags Generally Merged
* Unless misspelled|=|Tags Generally Deleted||
||Colleges||cell2||cell3||
||Tribes (Native Americans)||cell2||cell3||
||Reservations (Native Americans)||cell2||cell3||
||Boats (USS-[name])||cell2||cell3||
||Acts on the federal level||cell2||cell3||
||Countries||cell2||cell3||
||Unions||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
|=|Tags Generally Kept
*Unless misspelled|=|Tags Generally Merged
* Unless misspelled|=|Tags Generally Deleted||
||Colleges||cell2||cell3||
||Tribes (Native Americans)||cell2||cell3||
||Reservations (Native Americans)||cell2||cell3||
||Boats (USS-[name])||cell2||cell3||
||Acts on the federal level||cell2||cell3||
||Countries||cell2||cell3||
||Unions||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
||cell1||cell2||cell3||
