Filtering on

Given a news article or other concrete example, correctly extract the effect size versus statistical significance of a causal factor, and explain how each affects the importance and usefulness of the results.  

“It turned out that the prices of these stocks was to first order being determined by the buy/sell orders of just a few major pension funds.   After that, the second order effect was the automatic buying and selling from the index funds.   In fact, the small investors that we thought were important barely affected the prices of these stocks at all—a third or fourth order effect at best.” 

The commonest problem here is simply failing to consider orders of explanation, focusing on a small factor without remembering to consider its effect size.

Identify multiple causes for a given effect or outcome and evaluate the relative importance of each with respect to different contexts and goals.  

Given a concrete example, identify good and bad examples of evaluating and using the relative importance of causal factors. 

Given a concrete example, recognize and critique poor decisions that result from considering only the ranking - and not the relative magnitude - of causal factors.