Welcome to the blog of Human Face of Big Data! This project aims to build big data platforms to archive documents about urban renewal projects from 1970s, provide easy-to-use interfaces that can be used by old residents, archival scientists, and citizens, and ultimately reconstruct the digitized neighborhoods where people can see, read, and share their memories.
This project is two folds: (1) exploring map-based archiving and visualizing techniques, and (2) providing thorough data throughout the urban renewal processes by integrating various kinds of databases and navigation tools. For the map-based archiving and visualizations, we are currently developing digitizing processes using QGIS, ArcGIS, and other geographical/graphical tools to better present old maps and associated information on online platforms. Also, user-centered UI design methods are used to develop user-friendly interfaces.
If you are interested in this project, feel free to contact us!
Within the past month, the UX team has been working on transcriptions with the help of Jhon and Hyeong-gi. By the end of the week, the team should have around 30 transcriptions and have at least 3 data patterns. Their weekly tasks include: completing two documents per week before Sunday and meeting up on Monday to discuss results. The team hopes to get to the UX design by the week of November 15th. To keep in touch with the team, I message Justin and the others through GroupMe, a group text messaging app.
The major roadblock that the team is experiencing is communication and motivation. These issues can be fixed in a short amount of time.
For the past 2 weeks, the database team has been working on the tasks that they were assigned and goals that they have set as a team for the month of October. They started out by cleaning up the image files uploaded in UMD box. They went through all 2,681 images and made sure that the file name has the appropriate format and changed those that did not.
Since most of the members of the Database team are only learning about databases this semester, they have faced a lot of issue and roadblocks. However, they are also receiving a lot of help from more experienced members of the Web Development team as well as from Myeong. Despite all the challenges they are enjoying the learning process and will continue to work hard to achieve their goals for this month.
We are back with this week’s update about the project by the web team.
So far, Web Development team and Database Design team have set up the local environment so that any individual member can work on this project on his/her computer. Since everyone has different work environments (such as different OS and versions), we had to create a virtual machine that has exactly same environment so that we can avoid any unsupported error issue. To set up the virtual machine environment, we have used Vagrant script, which installs the necessary programs only.
Due to the unfamiliarity of the team members with the use of Vagrant, they faced issues and the Vagrant script was causing some error. However, in the end, the members were provided with the new Vagrant script by our project head, Myeong, that sets up the correct local work environment, and all the members were able to set the environment completely.
For more updates related to the project, stay tuned with us! Until then.. Good bye!
This Fall 2017, an updated group of contributors will be putting work into moving this important project forward.
Over the course of the summer, the continuing project group completed an immense amount of work, transcribing important data from ~500 document files. We still have another ~400 to go, but the progress that has been made has allowed us to identify information patterns. These patterns help us to begin to imagine the future of our online interface, as well as comprehend the social (Human Face) implications inherent to better understanding the raw data (of Big Data) that we have collected.
For the rest of 2017, we will be splitting the project into 4 major break-out groups.
- Web Development & System Administration
- Database Design & Management
- Digital Archivism & User Experience Design
- Project Management & User Needs Study
Check back each week as we plan to provide project updates, to keep you posted on our progress.
DCIC Project Showcase
We will be presenting our progress & findings in a showcase alongside other DCIC projects on December 4th, 2017 @ Hornbake from 4:30-6:30.