Area of Survey Assessment Correlatio Quasi True Causal Grounded Phenomenolo Ethnograp

Comparison n Experimenta Experimental Comparative Theory gy hy

l
Uses/Purposes To uncover meaning, gain
understanding and come to a
conclusion.
Application to Process of collecting, analyzing,
Public and presenting digital evidences.
Administration
/Information
Technology
Cybersecurity
Type of Data Qualitative Data
Needed -Documents/Record

Data Gathering surveys, observations, or interviews

Tool

Major Steps in 1. Extract Data

the Process 2. Check the authenticity of
the data
3. Analyze data
Data Analysis & Descriptive Analysis
Interpretation -Examining and interpreting the
data gathered
Advantages 1. Efficient method
2. Availability
3. Cost-effectiveness
4. Lack of obtrusiveness and
reactivity
5. Stability
6. Exactness
7. Coverage
Limitations 1. Insufficient detail
2. Low Retrievability
3. Biased Selectivty

COMPARISON MATRIX OF DOCUMENTARY ANALYSIS RESEARCH METHODS/DESIGNS

 Area of Survey Assessm Correlatio Quasi True Causal Grounded Phenomenology Ethnograp
Comparison ent n Experimenta Experimen Comparati Theory hy
l tal ve
Uses/Purposes Create mutually exclusive sets of data that
inform each other.

Application to Process of collecting, analyzing and

Public interpreting quantitative and qualitative data.
Administration
/Information
Technology
Cybersecurity
Type of Data Quantitative: Survey Responses
Needed Qualitative: Interviews

Data Gathering surveys, observations, or interviews

Tool

Major Steps in Conducts the quantitative and qualitative

the Process elements in the same phase of the research
process.
Data Analysis & Exploratory Analysis
Interpretation 1. Corroboration and validation process.
2. Illustrating quantitative results with
qualitative findings.
3. Examining relationships among variables.
Advantages 1. The design makes intuitive sense.
2. Efficient design in which both types are
collected during one phase.
3. Each type of data can be collected and
analyzed separately and independently.
4. The design facilitates the direct
comparison of participants’ perspective
gathered in an open-ended questioning
format with the perspective drawn from
the researchers’ standpoint in close-ended
questioning.
Limitations 1. Issues of different sample sizes.
2. The need to merge a text and a numeric
database.
3. The need to explain divergence when
comparing results.
COMPARISON MATRIX OF CONVERGENT PARALLEL RESEARCH METHODS/DESIGNS
 COMPARISON MATRIX OF POLICY REVIEW AND EVALUATION STUDY RESEARCH METHODS/DESIGNS

Area of Survey Assessmen Correlatio Quasi True Causal Comparative Grounded Phenomenolo Ethnograp
Comparison t n Experimenta Experiment Theory gy hy
l al
Uses/Purposes Evaluating the effectiveness of a
specific policy.

Application to Data Collection and Analysis

Public
Administration
/Information
Technology
Cybersecurity
Type of Data Qualitative and Quantitative Data
Needed -Public Policy

Data Gathering Survey Questionnaire, Interviews,

Tool Statistical analysis, and Document
Analysis
Major Steps in 1. Identifying Policy Effectiveness
the Process 2. Informing Policy Adjustment
3. Enhancing Decision Making
Data Analysis & Exploratory Analysis
Interpretation -Data Collection: Utilizes survey,
interviews, and secondary data.
-Analysis Techniques: apply statistical
analysis
Advantages Enables policy makers to learn about
what worked or did not work, and what
contributed to policy success or
failure.
Limitations 1. Funding Resources
2. Time Constraints
3. Data Access
4. Ethical Compliance
5. Collaboration Issues
6. Technological Gaps
7. Publication Delays
8. Research Bias
 Area of Survey Assessm Correlati Quasi Experimental True Causal Grounded Phenomenolo Ethnograp
Comparison ent on Experimen Comparati Theory gy hy
tal ve
Uses/Purposes To examine the cause-and-effect relationship
between an independent variable and a
dependent variable.
Application to 1. Safety Protocols Evaluation
Public 2. Environmental Impact Studies
Administration
/Information
Technology
Cybersecurity
Type of Data Quantitative Data
Needed -Literature

Data Gathering Interview questionnaires

Tool

Major Steps in 1. Identify the research problem

the Process 2. Formulate Hypothesis
3. Select Data Sources
4. Choose Variables
5. Conduct Data Analysis
6. Interpret Results
Data Analysis & Causal analysis
Interpretation -Examine the cause-and-effect relationship
between an independent variable and a
dependent variable.
Advantages 1. Ethical and Feasible
2. Cost Effective
3. Applicability Across Field

Limitations 1. Inconsistent Data Quality

2. Limited Availability
3. Restricted Sample
4. Uncontrolled Variables
COMPARISON MATRIX OF EX-POST FACTO RESEARCH METHODS/DESIGNS
 Area of Survey Assessment Correlati Quasi True Causal Grounded Phenomenolo Ethnograp
Comparison on Experiment Experimen Comparati Theory gy hy
al tal ve
Uses/Purposes 1. Protecting sensitive data
2. Maintaining System Integrity
3. Preventing Cyber Attacks
4. Compliance with regulations
5. Safeguarding Business Continuity
Application to 1. Risk Assessment
Public 2. Implementation of Security Controls
Administration 3. User Training and Awareness
/Information 4. Incident Response Plan
Technology 5. Regular Audits and Updates
Cybersecurity
Type of Data Quantitative Data
Needed -documents, video or audio tapes of
interviews, survey or other quantitative data
Data Gathering interviews, observations (direct and
Tool participant), questionnaires, and relevant
documents
Major Steps in 1. Understand the task
the Process 2. Understand the case
3. Identify the main problem
4. Analyze the problems
5. Develop and evaluate solutions
6. Make recommendations for action
Data Analysis & Descriptive Analysis
Interpretation -coding, thematic analysis, content analysis,
and narrative analysis
Advantages 1. Safeguards personal data
2. Maintains brand reputation
3. Improves data management
4. Strengthens cyber security posture
5. Sustains trustworthiness
6. Optimized access control

Limitations 1. Evolving Threats

2. Human Error
3. Resource Constraints
4. Privacy Concerns
COMPARISON MATRIX OF IT/CYBERSECURITY CASE STUDY RESEARCH METHODS/DESIGNS
 Area of Survey Assessmen Correlation Quasi True Causal Grounded Phenomenolo Ethnograp
Comparison t Experiment Experimen Comparati Theory gy hy
al tal ve
Uses/Purposes To try and determine the characteristics of
a population or particular phenomenon.

Application to 1. Data Collection

Public 2. Statistical Analysis
Administration 3. Interpretation
/Information
Technology
Cybersecurity
Type of Data Qualitative and quantitative data
Needed

Data Gathering surveys, interviews, observations, case

Tool studies, and portfolios

Major Steps in 1.Selection and statement of research

the Process problem
2. Identification of objectives and their
translation into criteria
3.Determination of tools and techniques
for data collection
4.Identification of research situation and
sample groups of population
5.Method and procedure of data collection
6.Analysis and interpretation of data
Data Analysis & Descriptive Analysis
Interpretation -identify patterns, relationships, and trends
within the data
Advantages 1. Provides a Comprehensive
Understanding
2. Non-invasive
3. Flexibility
4. Cost-effective
5. Easy to Replicate
6. Informs Future Research
Limitations 1. Causality
2. Confounding Variables
3. Over-generalization
COMPARISON MATRIX OF DESCRIPTIVE RESEARCH METHODS/DESIGNS
 Area of Survey Assessment Correlati Quasi True Causal Grounded Phenomenolo Ethnograp
Comparison on Experiment Experimen Comparati Theory gy hy
al tal ve
Uses/Purposes 1.Performance measurement
2.User feedback
3.Policy Development
4.Risk assessment
Application to 1.Methodological Rigor
Public 2.Stake Holder involvement
Administration 3.Data Analysis
/Information
Technology
Cybersecurity
Type of Data qualitative and quantitative data
Needed

Data Gathering Survey, interviews

Tool

Major Steps in Determine methods of assessment

the Process Gather evidence
Interpret evidence
Review results and implement change based
on results.
Data Analysis & Descriptive Analysis
Interpretation -“data collection” through “data analysis” to
“interpretation of results”
Advantages 1.Assesses the effectiveness
2.Identifies improvement areas
3.Measures user satisfaction.
Limitations 1.Resource Intensive
2.Potential Bias
3.Data Privacy Concerns
COMPARISON MATRIX OF ASSESSMENT AND EVALUATIVE RESEARCH METHODS/DESIGNS
 Area of Survey Assessme Correlation Quasi True Causal Grounded Phenomenology Ethnograp
Comparison nt Experimen Experimental Comparati Theory hy
tal ve
Uses/Purposes 1.Data Collection
2.Trend Analysis
3.Policy Development
Benchmarking
Application to 1.Clear Objectives
Public 2.Targer Population
Administration 3.Questionniare Development
/Information 4.Data Collection Methods
Technology
Cybersecurity
Type of Data Qualitative and Quantitative data
Needed

Data Gathering surveys, interviews, observations, case

Tool studies, and portfolios

Major Steps in 1.Selection and statement of research

the Process problem
2. Identification of objectives and their
translation into criteria
3.Determination of tools and techniques
for data collection
4.Identification of research situation and
sample groups of population
5.Method and procedure of data collection
6.Analysis and interpretation of data
Data Analysis & Descriptive Analysis
Interpretation - identifying patterns, trends, and
relationships within the data
Advantages 1. Multiple methods of data collection
2. Fast and cost-effective
3. Comprehensive
4. External validity
Limitations 1.Lack of Causality
2.Response Bias
3.Limited Depth
4.Sampling Issues
COMPARISON MATRIX OF DESCRIPTIVE SURVEY RESEARCH METHODS/DESIGNS
 Area of Survey Assessme Correlation Quasi True Causal Grounded Phenomenol Ethnograp
Comparison nt Experimen Experimen Comparati Theory ogy hy
tal tal ve
Uses/Purposes 1.Decision-making
2.Benchmarking
3.Understanding Contexts
Application to 1.Data Collection
Public 2.Criteria for Comparison
Administration 3.Analytical Tools
/Information
Technology
Cybersecurity
Type of Data Qualitative and Quantitative data
Needed

Data Gathering Surveys and Questionnaires, Interviews,

Tool Observations, Experiments

Major Steps in 1.Define your goals and questions

the Process 2.Identify relevant subjects for comparison
3.Gather data and information
4.Choose the right comparison framework
5.Analyze and interpret data
6.Draw conclusions and recommendations
Data Analysis Descriptive Analysis
&
Interpretation
Advantages 1.Data-Driven Decision-Making
2. Objective Assessment
3. Risk Assessment
4. Prioritization
5. Strategic Planning
6. Continuous Improvement
Limitations 1.Complexity
2.Subjectivity
3.Data availability
COMPARISON MATRIX OF COMPARATIVE ANALYSIS RESEARCH METHODS/DESIGNS
 Area of Survey Assessme Correlati Quasi Experimental True Causal Grounded Phenomenol Ethnograp
Comparison nt on Experimen Comparati Theory ogy hy
tal ve
Uses/Purposes 1.Hypothesis Thinking
2.Validation
3.Optimization
Application to 1.Control and Experimental Groups
Public 2.Randomization
Administration 3.Replicability
/Information
Technology
Cybersecurity
Type of Data Qualitative and Quantitative data
Needed

Data Gathering surveys, observations, interviews, or specialized

Tool tools

Major Steps in 1. defining the problem

the Process 2. making observations
3. forming a hypothesis
4. conducting an experiment
5. drawing conclusions.
Data Analysis Causal Analysis
& - cause and effect of relationships between
Interpretation variables
Advantages results can establish causation

Limitations 1.Artificial Environment

2.Ethical Consideration
3.Resource-Intensive
COMPARISON MATRIX OF CONTROLLED EXPERIMENTS RESEARCH METHODS/DESIGNS
 Area of Survey Assessme Correlatio Quasi True Causal Grounded Theory Phenomenol Ethnograp
Comparison nt n Experimenta Experimenta Comparati ogy hy
l l ve
Uses/Purposes Achieving knowledge and understanding of
a problem domain by building and
application of a designed artifact.
Application to Focused on systems development
Public approaches and methods. The dominant
Administration research philosophy in many disciplines has
/Information focused on developing cumulative, theory-
Technology based research results in order to make
Cybersecurity prescriptions.
Type of Data Qualitative data
Needed

Data Observation, interviews and questionnaires

Gathering Tool

Major Steps in Problem identification and motivation,

the Process objectives for a solution, design and
development, evaluation, and
communication
Data Analysis Descriptive Analysis
&
Interpretation
Advantages Democratizing digital engineering and
bridging the gap between behavioral
science and design science.
Limitations 1.Input Knowledge and Technology
2. Research Process
3.Research Artifact
4. Design Knowledge
COMPARISON MATRIX OF DESIGN SCIENCE RESEARCH METHODS/DESIGNS

Area of Survey Assessment Correlati Quasi True Causal Grounde Phenomenol Ethnograp
Comparison on Experimen Experimen Comparati d Theory ogy hy
tal tal ve
Uses/Purposes Provide an independent assessment that examines
all aspects of a proposed project, including
technical, economic, financial, legal, and
environmental considerations.
Application to Performed on a software project to understand the
Public viability of the product.
Administration
/Information
Technology
Cybersecurity
Type of Data Quantitative and Qualitative data
Needed

Data brainstorming, focus groups, surveys, and

Gathering Tool interviews

Major Steps in 1.Run a preliminary analysis

the Process 2.Evaluate financial feasibility
3.Run a market assessment
4.Consider technical and operational feasibility
5.Review project points of vulnerability
6.Propose a decision
Data Analysis Predictive Analysis
&
Interpretation
Advantages Aids in determining the potential success or failure
of a plan, venture, or product.

Limitations 1.Inadequate resources

2.Time or skipping stages
3.Budget
4.Availability of skilled personnel for studies and
for construction management
5.Human factors

COMPARISON MATRIX OF FEASIBILITY ANALYSIS RESEARCH METHODS/DESIGNS

 Area of Survey Assessment Correlatio Quasi True Causal Grounded Phenomenology Ethnograp
Comparison n Experiment Experiment Comparati Theory hy
al al ve
Uses/Purposes To understand and describe a specific
phenomenon in- depth and reach at the
essence of participants' lived experience of
the phenomenon.
Application to Phenomenological research on police works
Public focuses on the study of individual’s lived
Administration experiences and perceptions of criminal
/Information behavior.
Technology
Cybersecurity
Type of Data Qualitative data
Needed -interview

Data Interview, observation, focused groups and

Gathering Tool documentary analysis

Major Steps in 1.Bracketing

the Process 2.Intuiting
3.Analyzing
4.Describing
Data Analysis Descriptive Analysis
&
Interpretation
Advantages Descriptive phenomenology is a powerful
way to understand subjective experience and
to gain insights around people’s actions and
motivations, cutting through long-held
assumptions and challenging conventional
wisdom. It may contribute to the
development of new theories, changes in
policies, or changes in responses.
Limitations 1.Does not suit all health research
questions.
2.Language barriers
3. Gathering data and data analysis may be
time consuming and laborious
4. Results require interpretation without
researcher bias
5. Does not produce easily generalizable
data

COMPARISON MATRIX OF PHENOMENOLOGY RESEARCH METHODS/DESIGNS

 Area of Survey Assessm Correlati Quasi True Causal Grounde Phenomenology Ethnograp
Comparison ent on Experiment Experimen Comparativ d Theory hy
al tal e
Uses/Purposes Narration means the art of storytelling, and the
purpose of narrative writing is to tell stories.

Application to Part of the Police Report is the narrative. This is a

Public section in which an officer describes everything that
Administration he observes at the scene.
/Information
Technology
Cybersecurity
Type of Data Qualitative data
Needed

Data Qualitative survey, interview, recording of oral

Gathering Tool history, focus group

Major Steps in 1.organization and preparation of the data

the Process 2.obtaining a general sense of the information
3.the coding process
4.categories or themes
5.interpretation of the data
Data Analysis Descriptive Analysis
&
Interpretation
Advantages Aim to unravel consequential stories of people’s
lives as told by them in their own words and worlds.

Limitations 1.Time consuming

2.Focus on their lived experience and not comment
on the greater social movements
3.This research method relies heavily on the
memory of the subject.

COMPARISON MATRIX OF NARRATIVE INQUIRY RESEARCH METHODS/DESIGNS

 Area of Survey Assessm Correlati Quasi True Causal Grounde Phenomenol Ethnography
Comparison ent on Experiment Experimen Comparativ d Theory ogy
al tal e
Uses/Purposes studying how a person changes as they develop
over time

Application to Aims to protect software application code and data

Public against cyber threats.
Administration
/Information
Technology
Cybersecurity
Type of Data Qualitative or Quantitative data
Needed

Data Surveys or questionnaires, individual or group

Gathering Tool interviews, observations

Major Steps in 1: Identify the Problem.

the Process 2: Evaluate the Literature.
3: Create Hypotheses.
4: The Research Design.
5: Describe Population.
6: Data Collection.
7: Data Analysis.
8: The Report-writing.

Data Analysis Descriptive Analysis

&
Interpretation
Advantages 1.Examines changes between participants of
different ages at the same point in time
2.Provides information on age differences

Limitations 1.Cannot examine change over time

2.Limited to one time in history
3.Cohort differences confounded with age
differences

COMPARISON MATRIX OF DEVELOPMENTAL STUDY RESEARCH METHODS/DESIGNS

 Area of Survey Assessm Correlati Quasi True Causal Grounde Phenomenol Ethnography
Comparison ent on Experiment Experimen Comparativ d Theory ogy
al tal e
Uses/Purposes Aimed at solving specific problems and improving
practices through cyclical process of planning,
acting, observing, and reflecting

Application to System design and development

Public IT Management and processes
Administration User Experience
/Information Cybersecurity
Technology
Cybersecurity
Type of Data Qualitative data
Needed

Data surveys or questionnaires, individual or group

Gathering Tool interviews, observations, field notes or diaries,
narratives, documents
Major Steps in Problem Identification
the Process Planning
Action
Observation
Reflection
Dissemination
Data Analysis Descriptive Analysis
&
Interpretation
Advantages 1.Develop scientific attitudes
2.Help understand dynamic situation

Limitations 1.Action research carried out in a hurry

2.Action research has limited time
3.The researcher can bias in data collection,
analysis and interpretation
COMPARISON MATRIX OF ACTION RESEARCH METHODS/DESIGNS
 Area of Survey Assessm Correlati Quasi True Causal Grounde Phenomenology Ethnograp
Comparison ent on Experiment Experimen Comparativ d Theory hy
al tal e
Uses/Purposes 1.Understanding User Behavior
2.Evaluating the Effectiveness of Security Measures
3. Identifying Best Practices
4. Understanding the Impact of Cybersecurity Incidents
5. Gathering Information on Cybersecurity Threats
6. Understanding the Role of Human Factors in Cybersecurity
7. Identifying Areas for Improvement
8. Understanding the Perception of Cybersecurity Risk
9. Gathering Information on Cybersecurity Regulations and
Compliance
10. Understanding the Impact of Artificial Intelligence on
Cybersecurity
Application to Researchers need to design a questionnaire or survey
Public instrument that is relevant to the research question,
Administration identify a sample of participants, and collect data
/Information through online or offline means.
Technology
Cybersecurity
Type of Data Qualitative and Quantitative data
Needed

Data surveys, interviews, observations, and case studies

Gathering Tool

Major Steps in 1. Outline the research objective

the Process 2. Determine the tools and techniques to be used for data
collection
3. Define the target population and sample group
4. elect a method for data collection
5. Analyze the data collected
6. Write the report

Data Analysis Descriptive Analysis

&
Interpretation
Advantages 1. Multiple methods of data collection
2. Fast and cost-effective
3. Comprehensive
4. External validity
Limitations 1.Self-reported data
2.Biases in Sampling
3.Lack of Causality
COMPARISON MATRIX OF DESCRIPTIVE SURVEY METHODS/DESIGNS
 Area of Survey Assessm Correlati Quasi True Causal Grounde Phenomenology Ethnograp
Comparison ent on Experiment Experimen Comparativ d Theory hy
al tal e
Uses/Purposes 1.Gathering rich and detailed data on user
experiences
2. Identifying best practices and lessons learned
3. Understanding the psychological and social
factors that
influence cybersecurity behavior
4.Developing more effective cybersecurity training
and awareness programs
5. Understanding the impact of cybersecurity
incidents on
individuals and organizations
Application to 1.Identify the Research Question
Public 2. Select Participants
Administration 3. Collect Narrative Data
/Information 4. Analyze the Data
Technology 5. Interpret the Findings
Cybersecurity
Type of Data Qualitative data
Needed

Data Qualitative survey, interview, recording of oral

Gathering Tool history, focus group

Major Steps in 1. Identify participants who have relevant stories to

the Process share
2. Collect narrative data through interviews or focus
groups
3. Analyze the data using thematic analysis or other
qualitative
methods
Data Analysis Descriptive Analysis
&
Interpretation
Advantages 1.Rich data collection
2. Emphasis on individual experiences
3. Flexibility
Limitations 1.Subjective nature, 2. Limited generalizability
3. Reactivity, 4. Data collection bias
5. Time-consuming and resource-intensive
6. Data analysis challenges, 7. Reliability and
validity
8. Sampling limitations, 9. Data saturation
10. Ethical considerations
COMPARISON MATRIX OF NARRATIVE INQUIRY RESEARCH METHODS/DESIGNS