Providence has many configuration options beyond the initial setup through installation profiles. These options are handle in .conf files in the app/conf directory of your Providence installation. You will also find a /local folder, where you should create blank copies of files to customize options.
ALWAYS create a blank local version of your .conf file in app/conf/local and make edits there. Otherwise your changes can be overwritten.