The current conf.yaml combines both the testbed (machines) configuration and the test configuration. Splitting the two into different files could improve user experience.
There are other tickets related to this ticket (all relate to configuration files). First step is merging tickets or at least noting down which are related.