Basics and testing methodology

     The basis is a flexible methodology which is successfully used to develop start-ups and new products.
In the "flexible" methodology, after each iteration, a person observe the result and understand whether it meets the requirements or not. This is one of the advantages of a flexible model.
The methodology is suitable for a long life cycle of optics which constantly adapted to market conditions. Accordingly the optics requirements change in the process of improving.

As for factories, there are three main criteria that determine the complexity and type of testing methodology:

•    Scale of production
•    The complexity of the product
•    Availability of special requirements for product quality (Military, Marine, Tropical and etc.)

Regarding the planning fabrication of optics in small batches, it is sufficient to use functional testing (functionality of the device in record time), because it provides with the maximum speed, flexibility, debug the production process and adjust it in the early stages.

In terms of the planning of mass production it is necessary to take into account a variety of testing methods in order to obtain the minimum time for testing one device with the maximum coverage by tests.

In order to make serious optics testing in production it is necessary to combine different technologies in the necessary proportions, this is the best option for testing and analysis of quality. Therefore, it is necessary to create a pre-project analysis of testability and coverage tests, which will initially plan and justify the applicability of various testing approaches.

Testing includes the following steps:

•    Test Management (work planning)
•    Test Design (designing tests)
•    Test Execution (testing)
•    Test Analysis (analysis of results)

In my testing methodology, I rely on the basic documents:

•    MIL-STD-1241A, MILITARY STANDARD: OPTICAL TERMS AND DEFINITIONS (31 MAR 1967)
•    MIL-HDBK-141, MILITARY STANDARDIZATION HANDBOOK: OPTICAL DESIGN (05 OCT 1962)
•    Seil, K., Progress in binocular design, SPIE Proceedings Vol. 1533, 48, 1991

In my testing methodology, I rely on the basic standards:

•    The general document ISO 8402:1994 (Quality management and quality assurance – Vocabulary)
•    ISO 14490-5:2005, Optics and optical instruments - Test methods for telescopic systems - Part 5: Test methods for transmittance
•    ISO 12233:2017 Resolution and spatial frequency responses
•    The IP (IPX) and JIS Specification for Water/Dust Resistance/Proof
•    MIL-STD-810G ENVIRONMENTAL ENGINEERING CONSIDERATIONS AND LABORATORY TESTS
•    GJB150-2009 Environmental testing laboratory standard military equipment
•    GOST 15114-78 Telescope system for optical devices. Visual method of resolution limits determination
•    GOST R 50.909-98 Devices for visual observation
•    GOST 7048-81 Binoculars. Types and basic parameters. General technical requirements
•    GOST R ISO 9211-1-2014 Optics and optical instruments. Optical coatings. Part 1. Terms and definitions
•    GOST R ISO 9211-2-2014 Optics and optical instruments. Optical coatings. Part 2. Terms and definitions

There is no points system in the testing procedure as it alleviates conception of the advantages and disadvantages of the tested binoculars. Only defects will be evaluated they are the main  binoculars disadvantages. There are a five-level gradation system of defect severity and three-level defect Priority.

Test Plan:

•    Test plan identifier
•    Introduction
•    Test items
•    Features to be tested
•    Features not to be tested
•    Item pass/fail criteria
•    Test deliverables
•    Risks and contingencies
•    Approvals.

Test Summary Report:

•    Variances.
•    Summary of Results

A five-level system for grading the severity of a defect:

•    S1 (Blocker)
•    S2 (Critical)
•    S3 (Major)
•    S4 (Minor)
•    S5 (Trivial)

Defect priority:

•    P1 (High)
•    P2 (Medium)
•    P3 (Low)