#AcWri, #LTEC6040, #phdchat, Research, Research Methods

Search and Organize: The Literature Review

As you launch into a new research project, it is critical to think about how you will SEARCH and STORE an empirical literature search. Much of this organization starts with identifying a well-defined topic of study, and then identifying literature and scholarship around the previous work in this area. This process should support how you define your research topic scope/focus (e.g. inclusions/exclusions), established research methods (e.g.data collection/analysis), existing results/findings, and potential research suggestions for further investigations.

Step 1. Identify and Select a Research Topic to Study

For my #LTEC6040 early career scholars, the focus of study is geared towards digital learning/teaching. To prepare for a literature search, I suggest a few preliminary steps to SELECT and IDENTIFY a specific TOPIC for their research projects:

  • Interest: Find something you want to know more about so you remain interested and engaged in the project investigation. This might be related to your research agenda, either for your thesis/dissertation or general interests of study.
  • Ideas: Browse current periodicals (e.g. The Atlantic, Education: NPRNew York Times, Time), and online news resources for trends in the field you are looking at for digital teaching/learning (e.g. Inside Higher Ed, The Chronicle, Ed Surge, etc.).
  • Scope: Is your topic manageable? Avoid choosing a research topic that is too broad (too much information) or too narrow (too specialized/new/limited in appeal to find enough information). Consider limiting the time span, identifying a specific digital learning setting, or limiting this to a particular sample population/course/instructional method/lens.
  • Time: Choose a research topic you can work on for a set period of time. For example, this semester (3-4 months) is the length of time to set up a small-scale study, complete the ethics review, recruit a sample population, and start on a draft of a journal article. Always plan enough time to go through the empirical literature as you prepare the investigation and draft the paper.
  • Approach: There are different approaches possible for each research topic. Scholarly papers can analyze or explain a concept, narrate events, design, or developments in the field, or even argue for or against theory or idea. Additionally, you might choose to focus on a philosophical, historical, sociological, psychological, scientific, etc. approach.
  • Perspective:  Research topics can be examined through a variety of scholarly perspectives. Each research perspective or lens requires different sources of information so it is important to establish what aspect of the topic interests you most from the start.
  • Clarity: Be clear about the topic you are researching. Your research topic might need some adjustment as you gather information; however, you should always have a well-defined focus for your topic of search to ensure you stay on track and avoid wasting time with your literature search.

Step 2. Find Scholarly and Peer-Reviewed Evidence

Once this RESEARCH TOPIC is identified, next step is the literature review. This is critical part of research helps you to identify scholarly publications with evidence and investigation processes for your topic. Hart (1998) believes the literature review is an evaluative process is to determine how this empirical publications to answer the  following QUESTIONS for your scholarly search:

  • What are the key sources?
  • What are the major issues and debates around the topic?
  • What are the key theories, concepts, and ideas?
  • What are the epistemological and ontological grounds fro the discipline?
  • What are the political standpoints?
  • What are the origins of this topic?
  • What are the definitions involved with this topic?
  • How is knowledge on the topic structured and organized?
  • How have approaches to these questions increase our understanding and knowledge?

Step 3. Limit and Refine the Empirical Search

To help you keep your focus and direction for the literature search, it is critical to have a definitive argument/focus for your study. To best evaluate the scholarly works, Belcher (2009) offers suggestions to refine your literature review by reading materials that contribute to the central argument of your manuscript and limiting the following items for your search:

  • Set a time limit:  i.e. read nothing written over 10 years ago, five, or two (depending on your topic of research)
  • Language: limit to articles in English (or designated languages/preferences)
  • Questionable publishing outlets e.g. trade journals, non-peer reviewed, some conference proceedings not always suitable
  • Different geographical areas (by author country of origin)
  • Different time periods (related to your genre — this might apply to humanities more)
  • Different kinds of experiments (by your methods of study/research)
  • Different kinds of participants (by research sample type, size, etc)
  • Different variables (e.g. gender, age, etc.)
  • Without your keywords in the title or abstract – focus your search for these items
  • Non-electronic formats – if you can’t access the research from home/library resources

Step 4. Establish a System to Organize the Research Collection

Be sure to keep track of papers collected into a system of review. This might involve storing files, taking notes/annotations, and organizing articles into a citation system. I suggest setting this up early in your research life and I would definitely encourage you to use citation management software to track, store, and annotate articles you find for your literature search. Here are two platforms I use to tame the citations and literature collections [Learn more about citation management via the Research in Action podcast, episode no. 36]:

  1. Mendeley is a combination of a desktop application and a website which helps you manage, share and discover both content and contacts in research. You can store, save, annotate, and share documents with scholarly collaborators, plus manage and sync your references with a team in a group, or for yourself. You can easily drop in PDFs into the system to tag, cite, highlight, and organize your literature review. This is an excellent tool for team research and writing projects working from a distance.
  2. Zotero is utilized by a number of scholars as it is “an easy use tool easy-to-use tool to help you collect, organize, cite, and share your research sources.” Zotero hosts research groups and individuals who want to connect and collaborate with other scholars OR discover the works of others. It contains several disciplines through which a user can keep updated on and search for people to connect with. It is free to sign up and you download it to your computer.

Step 5. Search, Track, and Locate Relevant Papers

Find a way to organize and keep track of what you are searching (terms, keywords, filters, search strings, etc.) and where you might be finding these resources. Depending on your institution or access, you might not have a way to find ALL THE LITERATURE. Here are a few ways to expand your literature expedition and get access to empirical papers beyond your reach:

  • Search, Track and Set Alerts: Record the different search strings to recall what you find and perhaps to set up an alert (e.g. in Scopus, Summons, Google Scholar, etc.) that is relevant for this research topic or methodology. Here’s a screenshot of a Google spreadsheet for search for one of my projects: Screen Shot 2016-06-19 at 1.15.32 PM
  • Google Scholar search the “Cited by ###” section of the site: this is to identify other relevant paper on topic or learn more about this research thread, i.e. a discovery search for missing literature. This will also bring about the “grey” research that is not indexed or part of a database search.
  •  Use Backward & forward referencing search method: for collecting and reviewing publications to be inclusive of empirical literature. This might bring about relevant publications to be included in your own review and give insights to your topic OR the research methodology.
  • Search for Publications Beyond Reach: Articles that you are not able to access at your institutional library or databases I have access to, I will tweet #iCanHazPDF [in action #icanhazpdf] to ask my professional network on Twitter OR even connect to the author (by email, social network, etc.) to ask for a pre-print copy. Beyond this you can find articles via other academic search engines with access, such as Sci-Hub, Semantic Scholar, and many more research databases.

Step 6. Process and Understand the Literature Gathered

Beyond these methods for storing papers, think about how you will process and organize your literature collection. You might have notes drafted as you review to identify themes, issues, and concepts you want to include for your own paper. Here are few tips/tricks I’ve honed as I search for literature:

  • Take Fewer Notes: Tag articles in the software,  group articles into specific folders, skim abstracts to code/organize, and identify literature for easy recall and use later. Have a system for your own tags or references to recall/use later when writing. Make meaningful labels that connect to your specific research focus/scope.
  • Create an Annotated Bibliography: For smaller literature searches (or team support efforts) start a reference list of your citations in APA 6th Edition format with a brief line or two making about the study, methods, findings + personal thoughts on articles/methods you read for each citation. Create annotations on this reference list, these are notes, on why this paper is relevant and could be helpful for your own research.
  • Concept Mapping the Literature: It might help you to create a visual or graphic organizer to map out these ideas and piece items together for your own manuscript. This might be digital or even analog — break out the markers, crayons, post-its and more! Check out the great suggestions Pat Thomson offers on “spaces between the literature” for reviewing research; a.k.a. bushwhacking
  • Don’t Wait to Write: From the annotations and notes you have made on the collected papers, start organizing how and where they might fit into your article draft. These preliminary notes might be rough; however, if you pop some of your literature into an outline of a paper this will help you write a draft of an article when you have your data collected and analyzed.

What other advice do you have for getting started on a new research project? What suggestions do you have for searching and organizing a literature review? Let me know — I’m always keen to get a few new ideas for scholarship and practice. Thanks!

References:

Belcher, W. L. (2009). Writing your journal article in 12 weeks: A guide to academic publishing success. Thousand Oaks, CA: Sage Publications Inc.

Hart, C. (1998). Doing a literature review: Releasing the social science research imagination. Sage.

#LTEC6040, Online Learning, Research, SoTL

#LTEC6040 Asks, “Why Online?”

This academic semester I am fully immersed in online/digital scholarship of teaching and learning. This should not be a surprise, as I teach online and I’m often trying to figure out how distance/technology impacts learning. This year I am exploring HOW TO research digital teaching/learning practices in the courses I instruct and for the scholarship I’m drafting. According to Storify (soon to R.I.P. in May 2018), we’ve been talking about how to best define/label distributed learning for a while => here’s a Twitter thread captured from 3 years ago:  “State of ______ [insert: digital, online, etc.] Learning.” Under the umbrella term, distance education, comes a variety of ways to teach and learn. Additionally, the technological landscape in education has offered a number of ways to discuss, research, and design distributed learning. It’s complicated and challenging as the titles/labels for this type of teaching/learning hold many monikers in the empirical research: educational/learning technologies, networked learning, online education, blended learning environments, hybrid models, flipped learning, e-Learning, virtual environments, and more! Some technologies have the ability to design a flow of distributed learning that is seamless; whereas other digital facets create barriers and challenges.

Our learning spaces have a number of ways to infuse technology into distance education. With this comes even more ways to research and study these pedagogical practices for digital learning.  Regardless of the app, platform, or tool, we seem to have some aspect of “digital” infused into how we both teach and learn. As the options and variety of this online teaching/learning scholarship is broad, I am looking forward to supporting doctoral researchers who will identify one aspect of digital learning in our LTEC 6040: Theory and Practice of Distributed Learning (#LTEC6040 ) course. If you read this blog or connect with me on Twitter, you might see a few posts/shares using this hashtag to signal ideas and offer resources for these early career scholars as they work on investigating one piece of this distance/distributed learning pie.

The central focus of the #LTEC6040 course is to encourage doctoral researchers to define their own theory of online learning/teaching in context to:

  • Outlining empirical literature that supports (or refutes) their personal online learning/teaching theory
  • Identifying appropriate research methods to collect and analyze data connected to this personal online learning/teaching theory (small scale study)
  • Describing the ethical considerations and practices for this research study (e.g. IRB, recruitment, sample population, etc.)
  • Drafting an academic article manuscript for an appropriate publication outlet related to their field of inquiry in online teaching/learning

If you are so inclined, I would encourage you to join in the conversation and offer advice, resources,ideas, and readings for these scholars — as a number of you hold some invaluable expertise in a variety of areas we’ll be exploring for distributed learning this term [To see potential topics, see page 6 of the LTEC 6040 Course Syllabus]:

#LTEC6040 Blogs
https://jennie6040.blog/
https://nitiesite.wordpress.com/
https://jackimberly.wordpress.com/
https://crossingboundariesmedia.wordpress.com
https://osbornemarks.wordpress.com/
https://notlostnotyet.wordpress.com/
https://rickwoods2018.wordpress.com/
https://ltiwithme.wordpress.com/

We are just beginning to define what it means to examine online instruction/learning and unpacking distributed educational environments. In the initial conversations and class blog posts, most are still working on how they DEFINE and OUTLINE what it means to learn/teach online from their own experiences and expectations from the theories they are learning about in our program. Distance education research in higher education is fairly “young” (in comparison to other disciplines) and I am grateful I am surrounded by some fantastic colleagues and their respective departments/units/centers/teams who continue to find value in sharing digital teaching/learning scholarship resources. Here are a just a few (of many) examples:

Beyond these databases, reports, and resources, I am curating other digital learning materials and discourse to prompt discussion, debate and inquiry. Please feel free to share articles, blog posts, media, and more that might be suitable for diving into online teaching/learning research. Please feel free to leave suggestions in the comments below, if you have any. If you tweet, share what you think is critical for investigations in the digital age of learning using the course hashtag: #LTEC6040