#AcWri, #LTEC6040, #phdchat, Research, Research Methods

Search and Organize: The Literature Review

As you launch into a new research project, it is critical to think about how you will SEARCH and STORE an empirical literature search. Much of this organization starts with identifying a well-defined topic of study, and then identifying literature and scholarship around the previous work in this area. This process should support how you define your research topic scope/focus (e.g. inclusions/exclusions), established research methods (e.g.data collection/analysis), existing results/findings, and potential research suggestions for further investigations.

Step 1. Identify and Select a Research Topic to Study

For my #LTEC6040 early career scholars, the focus of study is geared towards digital learning/teaching. To prepare for a literature search, I suggest a few preliminary steps to SELECT and IDENTIFY a specific TOPIC for their research projects:

  • Interest: Find something you want to know more about so you remain interested and engaged in the project investigation. This might be related to your research agenda, either for your thesis/dissertation or general interests of study.
  • Ideas: Browse current periodicals (e.g. The Atlantic, Education: NPRNew York Times, Time), and online news resources for trends in the field you are looking at for digital teaching/learning (e.g. Inside Higher Ed, The Chronicle, Ed Surge, etc.).
  • Scope: Is your topic manageable? Avoid choosing a research topic that is too broad (too much information) or too narrow (too specialized/new/limited in appeal to find enough information). Consider limiting the time span, identifying a specific digital learning setting, or limiting this to a particular sample population/course/instructional method/lens.
  • Time: Choose a research topic you can work on for a set period of time. For example, this semester (3-4 months) is the length of time to set up a small-scale study, complete the ethics review, recruit a sample population, and start on a draft of a journal article. Always plan enough time to go through the empirical literature as you prepare the investigation and draft the paper.
  • Approach: There are different approaches possible for each research topic. Scholarly papers can analyze or explain a concept, narrate events, design, or developments in the field, or even argue for or against theory or idea. Additionally, you might choose to focus on a philosophical, historical, sociological, psychological, scientific, etc. approach.
  • Perspective:  Research topics can be examined through a variety of scholarly perspectives. Each research perspective or lens requires different sources of information so it is important to establish what aspect of the topic interests you most from the start.
  • Clarity: Be clear about the topic you are researching. Your research topic might need some adjustment as you gather information; however, you should always have a well-defined focus for your topic of search to ensure you stay on track and avoid wasting time with your literature search.

Step 2. Find Scholarly and Peer-Reviewed Evidence

Once this RESEARCH TOPIC is identified, next step is the literature review. This is critical part of research helps you to identify scholarly publications with evidence and investigation processes for your topic. Hart (1998) believes the literature review is an evaluative process is to determine how this empirical publications to answer the  following QUESTIONS for your scholarly search:

  • What are the key sources?
  • What are the major issues and debates around the topic?
  • What are the key theories, concepts, and ideas?
  • What are the epistemological and ontological grounds fro the discipline?
  • What are the political standpoints?
  • What are the origins of this topic?
  • What are the definitions involved with this topic?
  • How is knowledge on the topic structured and organized?
  • How have approaches to these questions increase our understanding and knowledge?

Step 3. Limit and Refine the Empirical Search

To help you keep your focus and direction for the literature search, it is critical to have a definitive argument/focus for your study. To best evaluate the scholarly works, Belcher (2009) offers suggestions to refine your literature review by reading materials that contribute to the central argument of your manuscript and limiting the following items for your search:

  • Set a time limit:  i.e. read nothing written over 10 years ago, five, or two (depending on your topic of research)
  • Language: limit to articles in English (or designated languages/preferences)
  • Questionable publishing outlets e.g. trade journals, non-peer reviewed, some conference proceedings not always suitable
  • Different geographical areas (by author country of origin)
  • Different time periods (related to your genre — this might apply to humanities more)
  • Different kinds of experiments (by your methods of study/research)
  • Different kinds of participants (by research sample type, size, etc)
  • Different variables (e.g. gender, age, etc.)
  • Without your keywords in the title or abstract – focus your search for these items
  • Non-electronic formats – if you can’t access the research from home/library resources

Step 4. Establish a System to Organize the Research Collection

Be sure to keep track of papers collected into a system of review. This might involve storing files, taking notes/annotations, and organizing articles into a citation system. I suggest setting this up early in your research life and I would definitely encourage you to use citation management software to track, store, and annotate articles you find for your literature search. Here are two platforms I use to tame the citations and literature collections [Learn more about citation management via the Research in Action podcast, episode no. 36]:

  1. Mendeley is a combination of a desktop application and a website which helps you manage, share and discover both content and contacts in research. You can store, save, annotate, and share documents with scholarly collaborators, plus manage and sync your references with a team in a group, or for yourself. You can easily drop in PDFs into the system to tag, cite, highlight, and organize your literature review. This is an excellent tool for team research and writing projects working from a distance.
  2. Zotero is utilized by a number of scholars as it is “an easy use tool easy-to-use tool to help you collect, organize, cite, and share your research sources.” Zotero hosts research groups and individuals who want to connect and collaborate with other scholars OR discover the works of others. It contains several disciplines through which a user can keep updated on and search for people to connect with. It is free to sign up and you download it to your computer.

Step 5. Search, Track, and Locate Relevant Papers

Find a way to organize and keep track of what you are searching (terms, keywords, filters, search strings, etc.) and where you might be finding these resources. Depending on your institution or access, you might not have a way to find ALL THE LITERATURE. Here are a few ways to expand your literature expedition and get access to empirical papers beyond your reach:

  • Search, Track and Set Alerts: Record the different search strings to recall what you find and perhaps to set up an alert (e.g. in Scopus, Summons, Google Scholar, etc.) that is relevant for this research topic or methodology. Here’s a screenshot of a Google spreadsheet for search for one of my projects: Screen Shot 2016-06-19 at 1.15.32 PM
  • Google Scholar search the “Cited by ###” section of the site: this is to identify other relevant paper on topic or learn more about this research thread, i.e. a discovery search for missing literature. This will also bring about the “grey” research that is not indexed or part of a database search.
  •  Use Backward & forward referencing search method: for collecting and reviewing publications to be inclusive of empirical literature. This might bring about relevant publications to be included in your own review and give insights to your topic OR the research methodology.
  • Search for Publications Beyond Reach: Articles that you are not able to access at your institutional library or databases I have access to, I will tweet #iCanHazPDF [in action #icanhazpdf] to ask my professional network on Twitter OR even connect to the author (by email, social network, etc.) to ask for a pre-print copy. Beyond this you can find articles via other academic search engines with access, such as Sci-Hub, Semantic Scholar, and many more research databases.

Step 6. Process and Understand the Literature Gathered

Beyond these methods for storing papers, think about how you will process and organize your literature collection. You might have notes drafted as you review to identify themes, issues, and concepts you want to include for your own paper. Here are few tips/tricks I’ve honed as I search for literature:

  • Take Fewer Notes: Tag articles in the software,  group articles into specific folders, skim abstracts to code/organize, and identify literature for easy recall and use later. Have a system for your own tags or references to recall/use later when writing. Make meaningful labels that connect to your specific research focus/scope.
  • Create an Annotated Bibliography: For smaller literature searches (or team support efforts) start a reference list of your citations in APA 6th Edition format with a brief line or two making about the study, methods, findings + personal thoughts on articles/methods you read for each citation. Create annotations on this reference list, these are notes, on why this paper is relevant and could be helpful for your own research.
  • Concept Mapping the Literature: It might help you to create a visual or graphic organizer to map out these ideas and piece items together for your own manuscript. This might be digital or even analog — break out the markers, crayons, post-its and more! Check out the great suggestions Pat Thomson offers on “spaces between the literature” for reviewing research; a.k.a. bushwhacking
  • Don’t Wait to Write: From the annotations and notes you have made on the collected papers, start organizing how and where they might fit into your article draft. These preliminary notes might be rough; however, if you pop some of your literature into an outline of a paper this will help you write a draft of an article when you have your data collected and analyzed.

What other advice do you have for getting started on a new research project? What suggestions do you have for searching and organizing a literature review? Let me know — I’m always keen to get a few new ideas for scholarship and practice. Thanks!

References:

Belcher, W. L. (2009). Writing your journal article in 12 weeks: A guide to academic publishing success. Thousand Oaks, CA: Sage Publications Inc.

Hart, C. (1998). Doing a literature review: Releasing the social science research imagination. Sage.

EdTech, Professional Development

Career Forum Roundtables – The #EdTechCareer Line Up for #et4online

EdTech1sm

The Emerging Technologies for Online Learning (#et4online) Conference in Las Vegas NV is just around the corner (April 9-11, 2013). As mentioned in a previous post, I will be helping to support a new initiative at the conference – the Career Forum Roundtables.

We are very excited to offer the career roundtables as an opportunity for graduate students, junior scholars, and other interested #et4online participants who would like to chat about Ed Tech career planning and development. If you are interested, please feel free to join us for any of the scheduled sessions, and take advantage of meeting the career roundtable facilitators who have offered to share their  career insights and experiences. 

CAREER FORUM ROUNDTABLES (#EdTechCareers)

Please join us in the Westwood Boardroom for three Career Forum Roundtable sessions:
EdTech Career Tracks
Tuesday, April 9 – 2:30pm-3:20pm
There are a number of career directions and opportunities to apply for with your graduate degree. Join this roundtable to ask career questions and gain advice on which path is right for you:
·     Higher Education Faculty/Instructor – teaching vs. research institutions
·     Industry Research & Development
·     Consulting/Other
Facilitators: Whitney Kilgore from Academic Partnerships & Dr. Kevin Grazino from Nevada State College
Career Skills
Wednesday, April 10 – 10:10am-11:00am
In developing career skills for the educational technology field, it is critical to get involved and connected to both professional affiliations and peers. Come learn about how to build your CV and also showcase your experiences, as we talk about:
·     Professional Networking
·     Getting Involved in Professional Organizations
·     Scholarship Development – teaching, publishing, service
·     Interview Advice
Facilitators:Dr. George Veletsianos from the University of Texas & Dr. Rachel Salas-Didier from Nevada State College & Dr. Tanya Joosten from the University of Wisconsin Milwaukee
Career Applications
Thursday, April 11 – 10:10am-11:00am
Applying to your first faculty position? Looking for industry positions? Perhaps you should consider how you present yourself via your job application. Join us as we talk about things to consider when developing your career materials, including:
·     CV & Resume Writing
·     ePortfolio Development
·     References
Facilitators: Dr. Amy Collier from Stanford University & Laura Pasquini from the University of North Texas
 
See you at #et4online!
Collaboration, Open Education, PLE

It’s Time for the Educational Remix…

It’s time to catch up with some fantastic scholastic chats in #eci831… and there are a few weeks to share. During #eci831 Week 10Brian LambScott Leslie discussed their experience in remixing education. In reviewing some inspiring media savants, examples, and ideas for open, remixed educational resources.In a true network environment – the application logic is relied onto the machines and built into the network itself. The open education movement introduced large quantities of formal education resources into the pool of content that can be mashed up and remixed for learners. Networks have evolved to the point where learners are no longer bound by space or time, which allows learners to direct and choose their personal learning environment objectives. There is now a “mashup of learning” medium to best support content knowledge and skill acquisition for learners. The process of remixing education is simply extending the existing concept. Mashing OERs as an Instructor (or DJ) includes this sample DJ workflow applied to education:

Image from Mashing OER Wiki

More resources that inspire openness & remixing: