# data[].attributes.headline
| Interconnectedness is one of three major components of a complex system  

# data[].attributes.subject
| Interconnectedness is one of three major components of a complex system  

# data[].attributes.body
Interconnectedness, non-ergodicity and non-linearity are three major characteristics of complex systems.

Interconnectedness means that in complex systems, components are connected to each other and dynamically influence one another. When studying complex systems, interconnectedness may present itself in graphs as fat tails or as the "regression to the tail".

# data[].attributes.attachment_link.title
CARMA 42: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| Surveys are a practical way to collect and study micronarratives 

# data[].attributes.subject
| Surveys are a practical way to collect and study micronarratives 

# data[].attributes.body
Micronarratives, also understood as short stories, viewpoints, or fragments, give meaning to how we perceive and understand our social world and how it is constructed. Observing and researching competing micronarratives, for example with surveys, may be fruitful in understanding various trends and experiences in a system. Through this understanding, systems such as organizations can be developed.

# data[].attributes.attachment_link.title
CARMA 33: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| The threshold model and the backfire effect are examples of how social networks shape individual thinking and behaviour, leading to significant group-level phenomena.  

# data[].attributes.subject
| The threshold model and the backfire effect are examples of how social networks shape individual thinking and behaviour, leading to significant group-level phenomena.  

# data[].attributes.body
Social networks, which are complex social systems, make individuals assess their relationships with other people and their behaviour in ways that would not happen without the networks.

One example of this is the threshold model, in which no one person would do a certain behaviour unless they see a certain amount of other people doing it. Individually nobody would litter at a festival, but once someone does it, a chain reaction of littering will occur. Person x will litter if they see one other person doing it, persons y and z will start littering once they have witnessed two people do so, and so on.

Another example of how social networks affect individual behaviour collectively, is the backfire effect, in which the members of the network acknowledge that a task should be performed but since they know that nobody else is performing it, they are unmotivated to perform it and "write it off" as something that's not for them.

# data[].attributes.attachment_link.title
CARMA 55: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| Micro-narrative survey responses can give us more contextual information that traditional survey responses.

# data[].attributes.subject
| Micro-narrative survey responses can give us more contextual information that traditional survey responses.

# data[].attributes.body
With micro-narrative survey responses we can find contextualised fragments from individuals experiences that can create more specific understanding that we cannot see in traditional survey responses. And from those experiences, we can find a shared thoughts that help us understand bigger phenomenon.

33: https://youtu.be/dg2mgPWD4SU

# data[].attributes.attachment_link.title
CARMA 33: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| In complex contexts we have wicked problems and changing circumstances. 

# data[].attributes.subject
| In complex contexts we have wicked problems and changing circumstances. 

# data[].attributes.body
Change can be systematic and thus clear, or it can contain unstable and changing features and parts. When we think that something is simple and stable, on closer inspection the details can actually become much more complicated.

48: https://youtu.be/j6aclqnxk_I

# data[].attributes.attachment_link.title
CARMA 48: Critical Appraisal of Research Methods and Analysis [PART VI BEGINS]

# data[].attributes.headline
| Thresholds distort our independent actions. 

# data[].attributes.subject
| Thresholds distort our independent actions. 

# data[].attributes.body
Video is about networks and the effect other people have on us and our opinions. We are not only affected by people around us but also by people around those people who we connect with. So we act a lot based on how other people around us decide to act.

55: https://youtu.be/1AVNjXT81jM

# data[].attributes.attachment_link.title
CARMA 55: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| Options for behavior when trying to detect an effect (in some particular context)

# data[].attributes.subject
| Options for behavior when trying to detect an effect (in some particular context)

# data[].attributes.body
Real effects found in research can be either non-existent or there can be some form of an effect in the context. If no effect can be found, the two options for behavior are either to give a correct negative by stating that there is no effect, or to give a false positive by stating that an effect is there. If the real effect exists, then options for behavior are to either give a false negative or a correct positive.

# data[].attributes.attachment_link.title
CARMA 13: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| Optionality and reducing the exposure of the downsides

# data[].attributes.subject
| Optionality and reducing the exposure of the downsides

# data[].attributes.body
In the video concrete examples on how to reduce the exposure to the downsides is presented. In addition, examples of optionality are presented, which means the ability to choose the best option from a variety of options.

# data[].attributes.attachment_link.title
CARMA 29: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| The way researchers handle data might significantly affect the validity of the study

# data[].attributes.subject
| The way researchers handle data might significantly affect the validity of the study

# data[].attributes.body
The video explains how data might not be what we think it is due to researchers practices while making the study. It helps to recognize how some of the new studies might not be valid due to something called "The garden of forking paths" which might take place in the research process and data analysis.

# data[].attributes.attachment_link.title
CARMA 08: Critical Appraisal of Research Methods and Analysis [PART II BEGINS]

# data[].attributes.headline
| Don’t jump straight to the conclusions, 'cause there are many types of errors to avoid in research

# data[].attributes.subject
| Don’t jump straight to the conclusions, 'cause there are many types of errors to avoid in research

# data[].attributes.body
17: There are many types of errors to avoid in research. Type I error is to say there is something when there is nothing, and type II error is say there is nothing when there actually is something. Type S error is a +/- error, e.g. saying something is positive when it is negative, and the type M error estimates wrongly the magnitude of the phenomenon (number of digits before the decimal place). So you should not jump straight to the conclusions!

# data[].attributes.attachment_link.title
CARMA 17: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| Science is about learning from mistakes

# data[].attributes.subject
| Science is about learning from mistakes

# data[].attributes.body
2: Science is in crisis because of the fear of mistakes. But behind the fear is bad frameworks for making mistakes. Mistakes are important in science because knowing what is not the point is also knowing better the phenomenon. Mistakes are also important to unveil with replication studies.

# data[].attributes.attachment_link.title
CARMA 02: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| Don’t go to the garden of forking paths!

# data[].attributes.subject
| Don’t go to the garden of forking paths!

# data[].attributes.body
8: The garden of forking paths can cause problems. You are not safe from your mind that keeps coming up with post-hoc hyptheses and won't be stopped from going fishing or p-hacking. Pre-registration makes sure you know what you predicted before seeing the data.

# data[].attributes.attachment_link.title
CARMA 08: Critical Appraisal of Research Methods and Analysis [PART II BEGINS]

# data[].attributes.headline
| Asymmetrical world and co-evolving components when considering methods and interventions in complex systems. 

# data[].attributes.subject
| Asymmetrical world and co-evolving components when considering methods and interventions in complex systems. 

# data[].attributes.body
Reality (systems) are full of details and nuances. We need to think what is a reasonable simplification of the reality we are studying, and what are the meaningful details of reality. In the world where there are co-evolving components and asymmetrical objects/phenomena, repeating the same action may not repeat the same reaction. And this should be methodologically considered when doing research in complex world. In an asymmetrical world large-scale research might give misleading results in particular contexts. "The map is not the terrain."

# data[].attributes.attachment_link.title
CARMA 36: Critical Appraisal of Research Methods and Analysis

# data[].attributes.body
Often we see the world and its happenings through a linear model. We should acknowledge that non-linear coupling/behavior are very common in nature. Many times efforts and effects do not increase in linear way (hand in hand), but rather the accumulation of things might eventually cause the system to break, or novel results to appear.

# data[].attributes.attachment_link.title
CARMA 44: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| The unfrozen state of attractor landscape and redirection of the system.

# data[].attributes.subject
| The unfrozen state of attractor landscape and redirection of the system.

# data[].attributes.body
In complexity-based planning, there are many things to take into consideration: the influence of behaviors, determinants act with each others and with the intervention itself, importance of de-stabilization and tipping points, network effects and evolutionary parallel processes. It is important to acknowledge that when the system is in the unfrozen state (see attractor landscape), it is much easier to redirect it, before it stabilizes again.

# data[].attributes.attachment_link.title
CARMA 54: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| Dynamics in complex and complicated contexts

# data[].attributes.subject
| Dynamics in complex and complicated contexts

# data[].attributes.body
49: https://www.youtube.com/watch?v=2qYPh6qzJjE&t=290s

We want to discover stable patterns in the world, to use them to advance whatever it is we value. But they are not always readily available. In the complex context you focus on exploration to find these patterns, whereas in the complicated context you make use of what is already known about the topic as to proceed.

# data[].attributes.attachment_link.title
CARMA 49: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| In crisis situations, people are probably smarter than you think

# data[].attributes.subject
| In crisis situations, people are probably smarter than you think

# data[].attributes.body
The video pointed out the question if individuals are making logical and rational decisions, or are the actions more like (panic) reactions. The context should always be taken into consideration. Video also introduces the viewer to the communications strategy of minimal potential harm.
63: https://www.youtube.com/watch?v=RhacEyIN59M

# data[].attributes.attachment_link.title
CARMA 63: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| Decomposition based planning and design and self-organized behaviour change

# data[].attributes.subject
| Decomposition based planning and design and self-organized behaviour change

# data[].attributes.body
52: https://www.youtube.com/watch?v=MxUSn1uZWeQ

Decomposition-based behaviour change process goes from determinants, such as motivation or determination, to behaviours and finally to the outcomes, which are hopefully positive. Planning starts from the right and moves to the left.

When changing behaviour individuals seek for autonomy, competence and relatedness. Meanwhile the individual is trying to adapt to the environment and to the actions of others, and in the process changes the context of other people's actions.

# data[].attributes.attachment_link.title
CARMA 52: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| Complicated problem-solving methods shouldn’t be used in a complex context.

# data[].attributes.subject
| Complicated problem-solving methods shouldn’t be used in a complex context.

# data[].attributes.body
Complicated problem-solving methods shouldn’t be used in a complex context. Complex problems require teamwork and combining fields of expertise.

# data[].attributes.attachment_link.title
CARMA 39: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| When trying to change human behavior with decomposition-based planning, bigger phenomena are chopped into smaller determinants.

# data[].attributes.subject
| When trying to change human behavior with decomposition-based planning, bigger phenomena are chopped into smaller determinants.

# data[].attributes.body
When doing interventions, we must be able to recognize the determinants behind the bigger phenomena – especially when talking about human behavior. Through these individual determinants bigger changes are possible in the long run.

# data[].attributes.attachment_link.title
CARMA 52: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| Repeated stupid risks shouldn't be taken, if you don’t want to do harm to yourself.

# data[].attributes.subject
| Repeated stupid risks shouldn't be taken, if you don’t want to do harm to yourself.

# data[].attributes.body
Repeated stupid risks shouldn't be taken if you don’t want to do harm to yourself. It can benefit the society but be fatal to a person. Data analysis can be helpful in (only) some situations.

# data[].attributes.attachment_link.title
CARMA 59: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| Black swans are unpredictable and big events, that can't be predicted but look obvious when they have happened.

# data[].attributes.subject
| Black swans are unpredictable and big events, that can't be predicted but look obvious when they have happened.

# data[].attributes.body
So called black swans are events, that have a big impact and are impossible to see before, but look obvious afterwards. There is an illusion that all is stable. A great example of this is a life of a pig before Christmas: all seems nice and calm until it doesn't.

# data[].attributes.attachment_link.title
CARMA 27: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| Complex and complicated systems have many different characteristics.

# data[].attributes.subject
| Complex and complicated systems have many different characteristics.

# data[].attributes.body
Here is a summary about how complex and complicated systems differ of each other. Complex systems are often unpredictable and nonlinear and they are also needed in our world where we live in big, changing communities. Complexity has always been a part of social systems, it is not a new thing.

# data[].attributes.attachment_link.title
CARMA 47: Critical Appraisal of Research Methods and Analysis [END OF PART V]

# data[].attributes.headline
| There are similarities in different complex systems, and understanding them can help.

# data[].attributes.subject
| There are similarities in different complex systems, and understanding them can help.

# data[].attributes.body
In this video you can get tips from where to read more about complexity and defining of the concept. There are many examples on how theory of complexity can be used in practice.

# data[].attributes.attachment_link.title
CARMA 35: Critical Appraisal of Research Methods and Analysis [PART V BEGINS]

# data[].attributes.headline
| An ideal flow of scientific process follows the path of first having open data and scripts, then achieving reproducible, robust, and replicable results, and finally ensuring that the results are generalisable. 

# data[].attributes.subject
| An ideal flow of scientific process follows the path of first having open data and scripts, then achieving reproducible, robust, and replicable results, and finally ensuring that the results are generalisable. 

# data[].attributes.body
Open data and scripts, along with generalisable results, are essential guidelines for conducting scientific research. Moreover, reproducibility, robustness, and replicability are highly important. The previous ones are also called an ideal flow of a scientific process. However, obstacles such as limited availability of open data, may hinder the implementation in practice.

09: https://youtu.be/s28Ztqy5m2M

# data[].attributes.attachment_link.title
CARMA 09: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| The replication crisis is not a new phenomenon in scientific research.

# data[].attributes.subject
| The replication crisis is not a new phenomenon in scientific research.

# data[].attributes.body
The current state of affairs in scientific research is not a new phenomenon since it has existed already since the 1950s. However, it’s the first time people have started doing something about it. As Ronald Fisher suggests, we don’t need isolated significant results, but a procedure of an experimentally demonstrable phenomenon that will most often conduct an experiment with statistically significant results.

07: https://youtu.be/8dk24GtX9nM

# data[].attributes.attachment_link.title
CARMA 07: Critical Appraisal of Research Methods and Analysis [END OF PART I]

# data[].attributes.headline
| P-value is a widely used statistical measure that defines the (statistical, not practical!) significance of research findings.

# data[].attributes.subject
| P-value is a widely used statistical measure that defines the (statistical, not practical!) significance of research findings.

# data[].attributes.body
Sir Ronald Fisher is credited with the invention of the p-value. P-value is a statistical measure, which is widely used in science to determine the significance of research findings. The threshold of 0,05 has become the norm in scientific research, even though the decision to use it was arbitrary.

03: https://youtu.be/3npz6j21JNA

# data[].attributes.attachment_link.title
CARMA 03: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| In social science research simplified models can’t take into account all the things that exist in the real world.

# data[].attributes.subject
| In social science research simplified models can’t take into account all the things that exist in the real world.

# data[].attributes.body
Common simplifications are made in social sciences. For example, in mediation analysis, you have to leave out a lot of networking components that exists in real world but can’t be taken into account in the study.

40: https://youtu.be/Ag9GR69iqHA

# data[].attributes.attachment_link.title
CARMA 40: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| Complexity-based planning requires knowing the landscape and exploring nearby possibilities.

# data[].attributes.subject
| Complexity-based planning requires knowing the landscape and exploring nearby possibilities.

# data[].attributes.body
In complexity-based planning knowing your landscapes is important. It is also recommended to start planning from where you are and exploring nearby opportunities that are close to you because you can’t know if those further away are desirable before you get there.

62: https://youtu.be/kuvy1Vvjf-E

# data[].attributes.attachment_link.title
CARMA 62: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| It is recommended that a wide variety of possible outcomes are considered before implementing the project.

# data[].attributes.subject
| It is recommended that a wide variety of possible outcomes are considered before implementing the project.

# data[].attributes.body
Instead of watching a project fail and doing a postmortem analysis, you should think about possible outcomes or scenarios before the implementation of the project. There are several outcomes that include that the project has no effect at all, no intended effect but positive side effect, backfiring and that later behaviour offsets positive effect, for example.

58: https://youtu.be/dgW_5qvefz8

# data[].attributes.attachment_link.title
CARMA 58: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
| Heuristics can be used in development and prevention.

# data[].attributes.subject
| Heuristics can be used in development and prevention.

# data[].attributes.body
Section summary: Prevention can improve health as well as save costs in health care.

Video-section connection: Prevention is important for our well-being and for reducing unnecessary risks from burdening health care.

61: https://youtu.be/PMDJuoPXSFE

# data[].attributes.attachment_link.title
CARMA 61: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Antifragile systems adapt and utilize hardships to their benefit.

# data[].attributes.subject
Antifragile systems adapt and utilize hardships to their benefit.

# data[].attributes.body
Section summary: Before intervening complex systems, we should know the system well and have a variety of ways in which the intervention could be done.

Video-section connection: Understanding complex systems is important if we want to benefit from them.

60: https://youtu.be/ekgWcBbDFsk

# data[].attributes.attachment_link.title
CARMA 60: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Humans can adapt to changes and issues in unexpected ways.

# data[].attributes.subject
Humans can adapt to changes and issues in unexpected ways.

# data[].attributes.body
Section summary: The state of health care has driven the health care system and people to compete; patients compete for access to treatment, and the workers try to maintain equality and trust in health care workers.

Video-section connection: Health care system’s issues and repair methods have made the people to use the system in a dirty way which can be concerning considering the future of the system.

57: https://youtu.be/s_C2q64GJ9c

# data[].attributes.attachment_link.title
CARMA 57: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
When orchestrating an intervention, it is crucial to assess the possible side-effects and unintended consequences the process and the result may have, to not make the situation worse than it was to begin with.

# data[].attributes.subject
When orchestrating an intervention, it is crucial to assess the possible side-effects and unintended consequences the process and the result may have, to not make the situation worse than it was to begin with.

# data[].attributes.body
Section summary: Interventions within complex systems require a good enough understanding of the context, the problem and how the solution may be reached.

Video-section connection: Not accounting for the complexity of an intervention, results may lead to an unexpected result that may be worse than the starting point.

57: https://youtu.be/s_C2q64GJ9c

# data[].attributes.attachment_link.title
CARMA 57: Critical Appraisal of Research Methods and Analysis

# data[].attributes.body
Section summary: Understand the complexity level of the landscape and act in various ways together

Video-section connection: The change is possible if you keep the level of the complexity in mind and work together in various ways.

56: https://youtu.be/aIN11rNTRDU

# data[].attributes.attachment_link.title
CARMA 56: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
The Decomposition based approach/intervention is not entirely sufficient with social issues, for example the side effects of social policy should be considered when doing interventions (studying the interaction and patterns between the components of complex system).

# data[].attributes.subject
The Decomposition based approach/intervention is not entirely sufficient with social issues, for example the side effects of social policy should be considered when doing interventions (studying the interaction and patterns between the components of complex system).

# data[].attributes.body
Section summary: Intervention mapping in complex systems need continuous monitoring and reassessment.

Video-section connection: Intervention in complex social systems needs continuous monitoring and reassessment of interactions and patterns between the components of the complex system.

53: https://youtu.be/2rBYEKe1INo

# data[].attributes.attachment_link.title
CARMA 53: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Societal and individual problems catalysing changes

# data[].attributes.subject
Societal and individual problems catalysing changes

# data[].attributes.body
Section summary: There is always a need to catalyse change

Video-section connection: The video introduces the viewer to the concept of intervention.

51: https://youtu.be/EZ7Z4yHVAOw

# data[].attributes.attachment_link.title
CARMA 51: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
To intervene effectively in social systems, it is essential to first understand the environmental context.

# data[].attributes.subject
To intervene effectively in social systems, it is essential to first understand the environmental context.

# data[].attributes.body
Section summary: Understanding human behavior and the context in which it occurs is significantly important in addressing modern problems, such as the COVID-19 pandemic.

Video-section connection: Understanding the interplay between human behavior and its context is essential for effective intervention and positive change in social systems.

51: https://youtu.be/EZ7Z4yHVAOw

# data[].attributes.attachment_link.title
CARMA 51: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Ashby’s law states that the system must have enough variety for the environment to be sufficient.

# data[].attributes.subject
Ashby’s law states that the system must have enough variety for the environment to be sufficient.

# data[].attributes.body
Section summary: Shortage of health care professionals is a complex problem.

Video-section connection: Ashby’s law could help to understand problems in health care.

50: https://youtu.be/r55WIEI8eH0

# data[].attributes.attachment_link.title
CARMA 50: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Ashby’s law is relevant to understand when thinking about simple law of how we can response to the different challenges.

# data[].attributes.subject
Ashby’s law is relevant to understand when thinking about simple law of how we can response to the different challenges.

# data[].attributes.body
Section summary: We need more variety in organizations and teams to be able to meet the growing demands of intensified work environments.

Video-section connection: If we have more responses than the environment demands we will come up with the solutions.

50: https://youtu.be/r55WIEI8eH0

# data[].attributes.attachment_link.title
CARMA 50: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
The attractor landscapes in different situations.

# data[].attributes.subject
The attractor landscapes in different situations.

# data[].attributes.body
Section summary: The videos and the sections provide information about different models to use in research.

Video-section connection: The videos and the sections provide information about different models to use in research.

46: https://youtu.be/mKbpt11hX2A

# data[].attributes.attachment_link.title
CARMA 46: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Due to learning we can change the landscape.

# data[].attributes.subject
Due to learning we can change the landscape.

# data[].attributes.body
Section summary: We need to move hills to have an impact on our system.

Video-section connection: The change is slow and our systems can thrive on uncertainty.

46: https://youtu.be/mKbpt11hX2A

# data[].attributes.attachment_link.title
CARMA 46: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Attractor landscapes help to understand the dynamics behind behavioral change and what kind of complexity they contain.

# data[].attributes.subject
Attractor landscapes help to understand the dynamics behind behavioral change and what kind of complexity they contain.

# data[].attributes.body
Section summary: Understanding complex systems means understanding how the components within a system are related to one another and how they interact to produce emergent properties.

Video-section connection: You need to understand very thoroughly what influences complex systems to be able to change them.

45: https://youtu.be/Rw8663Caev0

# data[].attributes.attachment_link.title
CARMA 45: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Ergodicity is a principle (and often an error in thought process) that assumes that ensemble and time averages are equal; for example, the average outcome of the group equals the average outcome of one person over time.

# data[].attributes.subject
Ergodicity is a principle (and often an error in thought process) that assumes that ensemble and time averages are equal; for example, the average outcome of the group equals the average outcome of one person over time.

# data[].attributes.body
Section summary: To be able to respond to unpredictable changes in our environment we must treat our world as a complex system, which keeps getting more interconnected through globalization and technology, is faced with constant changes, and is composed of a magnitude of small interacting components.

Video-section connection: Non-ergodicity is character of complex systems.

43: https://youtu.be/YQHVi5boKBw

# data[].attributes.attachment_link.title
CARMA 43: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Complex and complicated systems have their typical characteristics.

# data[].attributes.subject
Complex and complicated systems have their typical characteristics.

# data[].attributes.body
Section summary: Wicked problems might appear more easily in the complex environment (for example health care sector).

Video-section connection: Wicked problems might appear more easily in the complex environment (for example health care sector).

38: https://youtu.be/A5Ni6ddcZRg

# data[].attributes.attachment_link.title
CARMA 38: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
It might be impossible to predict all the consequences of our actions.

# data[].attributes.subject
It might be impossible to predict all the consequences of our actions.

# data[].attributes.body
Section summary: Defining whether we are dealing with a complex or complicated environment is a crucial step in a decision-making process.

Video-section connection: Even though predicting all the consequences and outcomes of our actions might be impossible, understanding complexity can help us a lot.

38: https://youtu.be/A5Ni6ddcZRg

# data[].attributes.attachment_link.title
CARMA 38: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
The world is getting more complex because so many systems are ever changing and adaptive.

# data[].attributes.subject
The world is getting more complex because so many systems are ever changing and adaptive.

# data[].attributes.body
Section summary: Understanding complex systems and systems thinking should be the base of decision making.

Video-section connection: The complexity of the world requires decision makers to take systems thinking into consideration when trying to make social change.

38: https://youtu.be/A5Ni6ddcZRg

# data[].attributes.attachment_link.title
CARMA 38: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
An interaction-dominant system may or may not work like you want, because the problem emerges interactions between components.

# data[].attributes.subject
An interaction-dominant system may or may not work like you want, because the problem emerges interactions between components.

# data[].attributes.body
Section summary: The greater the number of possible behaviors, the greater the complexity.

Video-section connection: You can't always predict the behavior of developed systems.

37: https://youtu.be/V5BKUEPyhOQ

# data[].attributes.attachment_link.title
CARMA 37: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Interaction dominant causalities are like butterfly effects.

# data[].attributes.subject
Interaction dominant causalities are like butterfly effects.

# data[].attributes.body
Section summary: In complex systems there are interaction dominant causalities, which means that phenomenon or “problems” arise from the interconnected relations and interactions between different components in the system.

Video-section connection: That studying complex systems we need to understand the emergent, adaptive and highly interconnected nature of these systems.

37: https://youtu.be/V5BKUEPyhOQ

# data[].attributes.attachment_link.title
CARMA 37: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Sensemaking is a cognitive activity that happens through narratives, and it helps us to make complex world more coherent and understandable.

# data[].attributes.subject
Sensemaking is a cognitive activity that happens through narratives, and it helps us to make complex world more coherent and understandable.

# data[].attributes.body
Section summary: In ecological rationality perspective human rationality is defined by correspondence rather than by logical coherence, and when studying and interpreting human behavior the context (physical, ideological, cultural, emotional etc.) should be considered comprehensively.

Video-section connection: The connection is that sensemaking happens through people's previous experiences and narratives, and that it might be possible that people correspond to the environment or event through their personal narratives.

32: https://youtu.be/JafZ_lktVSo

# data[].attributes.attachment_link.title
CARMA 32: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
It’s helpful to the project leader to lean on heuristics.

# data[].attributes.subject
It’s helpful to the project leader to lean on heuristics.

# data[].attributes.body
Section summary: Heuristics can be many times the best map possible.

Video-section connection: Heuristics can be many times the best map for the project leading and other purposes as well.

31: https://youtu.be/W34G_k5k_Rc

# data[].attributes.attachment_link.title
CARMA 31: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
There are different ways to make heuristic decisions.

# data[].attributes.subject
There are different ways to make heuristic decisions.

# data[].attributes.body
Section summary: Heuristics make our decision-making easier.

Video-section connection: Different heuristics are used depending on the situation, which results in easier decision-making.

31: https://youtu.be/W34G_k5k_Rc

# data[].attributes.attachment_link.title
CARMA 31: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Heuristics are a big part of human decision making even in organizational level, which is why understanding them is important.

# data[].attributes.subject
Heuristics are a big part of human decision making even in organizational level, which is why understanding them is important.

# data[].attributes.body
Section summary: Heuristics simplify decision-making process, but circumstances and environment determine whether the heuristic works well.

Video-section connection: Using heuristics in your favour in organizational decision making requires being aware of you circumstances and environment.

30: https://youtu.be/1rRrmnKslfA

# data[].attributes.attachment_link.title
CARMA 30: Critical Appraisal of Research Methods and Analysis

# data[].attributes.body
Section summary: The video pointed out some main aspects of the heuristics as a psychological term

Video-section connection: The video pointed out some main aspects of the heuristics as a psychological term

30: https://youtu.be/1rRrmnKslfA

# data[].attributes.attachment_link.title
CARMA 30: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Heuristics enable one to outperform complex strategies with less information.

# data[].attributes.subject
Heuristics enable one to outperform complex strategies with less information.

# data[].attributes.body
Section summary: In healthcare environment both patient and a healthcare professional can be using the same tool (heuristics) to come to a certain conclusion.

Video-section connection: Heuristical thinking can make you blind when it comes to for example dealing with data.

30: https://youtu.be/1rRrmnKslfA

# data[].attributes.attachment_link.title
CARMA 30: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Heuristics enhance our thinking instead of limiting it.

# data[].attributes.subject
Heuristics enhance our thinking instead of limiting it.

# data[].attributes.body
Section summary: We cannot predict the uncertainty.

Video-section connection: It is sometimes impossible to predict the outcomes but still, there is something we can do to understand future and its complexity better.

30: https://youtu.be/1rRrmnKslfA

# data[].attributes.attachment_link.title
CARMA 30: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
All decisions aren’t made with similar risks or possible benefits, and you need different kind of information when making different decisions.

# data[].attributes.subject
All decisions aren’t made with similar risks or possible benefits, and you need different kind of information when making different decisions.

# data[].attributes.body
Section summary: Decision-making is often not so data-based as you might think, and it can still be valid.

Video-section connection: It is important to know what kind of decision you are making to gather enough information for a good outcome.

28: https://youtu.be/4l4XHs0Qzg4?l

# data[].attributes.attachment_link.title
CARMA 28: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Our brains ignore part of available information when we are focusing on another aspects or tasks.

# data[].attributes.subject
Our brains ignore part of available information when we are focusing on another aspects or tasks.

# data[].attributes.body
Section summary: Heuristic decision-making can be seen in everyday use of technological devices and programs.

Video-section connection: We as humans cannot put every useful detail from a technical device or program into practice because even if we attend to the information, it doesn’t mean we would act on it correctly.

26: https://youtu.be/dyq9oddV-e0

# data[].attributes.attachment_link.title
CARMA 26: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
People have a limited capacity to absorb information from their environment if they are not consciously paying attention to it.

# data[].attributes.subject
People have a limited capacity to absorb information from their environment if they are not consciously paying attention to it.

# data[].attributes.body
Section summary: Heuristic reasoning is a way for humans to make swift and good-enough decisions when grasping the full complexity of an issue is not impossible.

Video-section connection: Human brains have developed to process only a certain amount of data at a time which is reflected in our cognitive functions and tendencies.

26: https://youtu.be/dyq9oddV-e0

# data[].attributes.attachment_link.title
CARMA 26: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
It is a tricky problem that an average may not exist, and our findings must be summarized with care.

# data[].attributes.subject
It is a tricky problem that an average may not exist, and our findings must be summarized with care.

# data[].attributes.body
22: https://youtu.be/CRAEHM_ct48

# data[].attributes.attachment_link.title
CARMA 22: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Is it right to claim that your “less wrong” result is right?

# data[].attributes.subject
Is it right to claim that your “less wrong” result is right?

# data[].attributes.body
21: https://youtu.be/EnSp7xjkjVk

# data[].attributes.attachment_link.title
CARMA 21: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Be critical and curious when interpreting research results.

# data[].attributes.subject
Be critical and curious when interpreting research results.

# data[].attributes.body
18: https://youtu.be/a5I9yaR9s2k

# data[].attributes.attachment_link.title
CARMA 18: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Misinterpretations in science - intentional or unintentional - lead to someone losing.

# data[].attributes.subject
Misinterpretations in science - intentional or unintentional - lead to someone losing.

# data[].attributes.body
23: https://youtu.be/AaLa6WE-j8E

# data[].attributes.attachment_link.title
CARMA 23: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Visualizing data is important, but the way it’s done should be thought through carefully.

# data[].attributes.subject
Visualizing data is important, but the way it’s done should be thought through carefully.

# data[].attributes.body
20: https://youtu.be/hR8nLkpUABw

# data[].attributes.attachment_link.title
CARMA 20: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
The surroundings such as social media content can affect answers of research participants and the test results.

# data[].attributes.subject
The surroundings such as social media content can affect answers of research participants and the test results.

# data[].attributes.body
21: https://youtu.be/EnSp7xjkjVk

# data[].attributes.attachment_link.title
CARMA 21: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Making data and graphs more understandable would be possible and prevent disinformation from spreading.

# data[].attributes.subject
Making data and graphs more understandable would be possible and prevent disinformation from spreading.

# data[].attributes.body
21: https://youtu.be/EnSp7xjkjVk

# data[].attributes.attachment_link.title
CARMA 21: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Individuals and averages fall into a complex tie-up in research.

# data[].attributes.subject
Individuals and averages fall into a complex tie-up in research.

# data[].attributes.body
24: https://youtu.be/zfBpGE5CbbM

# data[].attributes.attachment_link.title
CARMA 24: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
The importance of the basics: you must have good basic knowledge and understanding of statistics to understand what you are doing with your data (with descriptive statistics and descriptive charts), and also to be able to question and be critical.

# data[].attributes.subject
The importance of the basics: you must have good basic knowledge and understanding of statistics to understand what you are doing with your data (with descriptive statistics and descriptive charts), and also to be able to question and be critical.

# data[].attributes.body
20: https://youtu.be/hR8nLkpUABw

# data[].attributes.attachment_link.title
CARMA 20: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Bar graphs are not the most informative way of visualizing paired data

# data[].attributes.subject
Bar graphs are not the most informative way of visualizing paired data

# data[].attributes.body
19: https://youtu.be/mQ7AsUWhSGQ

# data[].attributes.attachment_link.title
CARMA 19: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Questioning is needed, since significant findings and interesting research papers are often made at the expense of transparency and validity. 

# data[].attributes.subject
Questioning is needed, since significant findings and interesting research papers are often made at the expense of transparency and validity. 

# data[].attributes.body
06: https://youtu.be/LwqLQyPl1a8

# data[].attributes.attachment_link.title
CARMA 06: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
The main point of the open science discourse is to understand the message of the fairy tale ‘the emperor has no clothes’. 

# data[].attributes.subject
The main point of the open science discourse is to understand the message of the fairy tale ‘the emperor has no clothes’. 

# data[].attributes.body
05: https://youtu.be/7a2zaizVveM

# data[].attributes.attachment_link.title
CARMA 05: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Mistakes can be found even from the places you wouldn’t have expected to find them, especially if your own too positive expectations and beliefs are blinding you.

# data[].attributes.subject
Mistakes can be found even from the places you wouldn’t have expected to find them, especially if your own too positive expectations and beliefs are blinding you.

# data[].attributes.body
14: https://youtu.be/wSGaPLuRj5o

# data[].attributes.attachment_link.title
CARMA 14: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
The change brought forward by the replication crisis is not only crucial for the advancement of the scientific field, but for the societal and political wellbeing as well.

# data[].attributes.subject
The change brought forward by the replication crisis is not only crucial for the advancement of the scientific field, but for the societal and political wellbeing as well.

# data[].attributes.body
06: https://youtu.be/LwqLQyPl1a8

# data[].attributes.attachment_link.title
CARMA 06: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
In research p-value is not everything and a large p-value does not mean that some social phenomenon does not exist.

# data[].attributes.subject
In research p-value is not everything and a large p-value does not mean that some social phenomenon does not exist.

# data[].attributes.body
12: https://youtu.be/L6txTU1c7Ao

# data[].attributes.attachment_link.title
CARMA 12: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
While gaining access to new data, when taking a look into the field of well-being at work, the research to accomodate the needs of the evolving working life, there must be a look taken to reproductibilty in order to generate new information and also to take advantage of the previous studies and findings.

# data[].attributes.subject
While gaining access to new data, when taking a look into the field of well-being at work, the research to accomodate the needs of the evolving working life, there must be a look taken to reproductibilty in order to generate new information and also to take advantage of the previous studies and findings.

# data[].attributes.body
14: https://youtu.be/wSGaPLuRj5o

# data[].attributes.attachment_link.title
CARMA 14: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
To build trust between science and different parts of organizations, such as governments, we need replicable and reliable research.

# data[].attributes.subject
To build trust between science and different parts of organizations, such as governments, we need replicable and reliable research.

# data[].attributes.body
01: https://youtu.be/Bnbnp1cfOJI

# data[].attributes.attachment_link.title
CARMA 01: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Selective reporting tells only one side of the story.

# data[].attributes.subject
Selective reporting tells only one side of the story.

# data[].attributes.body
10: https://youtu.be/K9jItLmy-cs

# data[].attributes.attachment_link.title
CARMA 10: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
How does the mode/form of reasoning (inductive/deductive) affect to concept formation and operationalizing concepts, and through this to the final results of the research.

# data[].attributes.subject
How does the mode/form of reasoning (inductive/deductive) affect to concept formation and operationalizing concepts, and through this to the final results of the research.

# data[].attributes.body
11: https://youtu.be/OombFmEwjhg

# data[].attributes.attachment_link.title
CARMA 11: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Tackling replication crisis requires broader access to data and journals to be more willing to publish replication studies.

# data[].attributes.subject
Tackling replication crisis requires broader access to data and journals to be more willing to publish replication studies.

# data[].attributes.body
01: https://youtu.be/Bnbnp1cfOJI

# data[].attributes.attachment_link.title
CARMA 01: Critical Appraisal of Research Methods and Analysis

# data[].attributes.headline
Challenge and question research findings.

# data[].attributes.subject
Challenge and question research findings.

# data[].attributes.body
04: https://youtu.be/wFS5FXSL6wE

# data[].attributes.attachment_link.title
CARMA 04: Critical Appraisal of Research Methods and Analysis