The collection and analysis of evidence to test a proposition is one of the hallmarks of empirical research.
Non-empirical research articles focus more on theories, methods, well-supported opinions, and their implications for research. Non-empirical research includes comprehensive review or analysis of journal literature or articles that focus on methodology. It may rely on or analyze empirical research literature but does not need to be essentially data- or evidence-driven as empirical research is.
The question of whether empirical research is always peer-reviewed confuses apples and oranges, namely, peer-reviewed articles publications and common research methodologies.
Knowing how to quickly identify some common types of non-empirical research articles in peer-reviewed journals can help speed up your search. Here are some brief definitions and examples.