Quantification of physical activity (PA) depends on the type of measurement and analysis method making it difficult to compare adherence to PA guidelines. Therefore, test-retest reliability, validity, and stability for self-reported (i.e., questionnaire and diary) and device-based measured (i.e., accelerometry with 10/60 s epochs) PA was compared in 32 adults and 32 children from the SMARTFAMILY study to examine if differences in these measurement tools are systematic. PA was collected during two separate measurement weeks and the relationship for each quality criteria was analyzed using Spearman correlation. Results showed the highest PA values for questionnaires followed by 10-s and 60-s epochs measured by accelerometers. Levels of PA were lowest when measured by diary. Only accelerometry demonstrated reliable, valid, and stable results for the two measurement weeks, the questionnaire yielded mixed results and the diary showed only a few significant correlations. Overall, higher correlations for the quality criteria were found for moderate than for vigorous PA and the results differed between children and adults. Since the differences were not found to be systematic, the choice of measurement tools should be carefully considered by anyone working with PA outcomes, especially if vigorous PA is the parameter of interest.