feat(docs): add new docs and readme (#1529)

Co-authored-by: sergargar <sergio@verica.io>
Co-authored-by: n4ch04 <nachor1992@gmail.com>

docs/about.md

@@ -0,0 +1,26 @@
+---
+hide:
+- toc
+---
+# About
+
+## Author
+Prowler was created by **Toni de la Fuente** in 2016.
+
+| ![](/img/toni.png)<br>[![Twitter URL](https://img.shields.io/twitter/url/https/twitter.com/toniblyx.svg?style=social&label=Follow%20%40toniblyx)](https://twitter.com/toniblyx)|
+|:--:|
+| <b>Toni de la Fuente </b>|
+
+## Maintainers
+Prowler is maintained by the Engineers of the **Prowler Team** :
+
+| ![](/img/nacho.png)[![Twitter URL](https://img.shields.io/twitter/url/https/twitter.com/NachoRivCor.svg?style=social&label=Follow%20%40NachoRivCor)](https://twitter.com/NachoRivCor) | ![](/img/sergio.png)[![Twitter URL](https://img.shields.io/twitter/url/https/twitter.com/sergargar1.svg?style=social&label=Follow%20%40sergargar1)](https://twitter.com/sergargar1) |![](/img/pepe.png)[![Twitter URL](https://img.shields.io/twitter/url/https/twitter.com/jfagoagas.svg?style=social&label=Follow%20%40jfagoagas)](https://twitter.com/jfagoagas) |
+|:--:|:--:|:--:
+| <b>Nacho Rivera</b>| <b>Sergio Garcia</b>| <b>Pepe Fagoaga</b>|
+
+
+
+## License
+
+Prowler is licensed as **Apache License 2.0** as specified in each file. You may obtain a copy of the License at
+<http://www.apache.org/licenses/LICENSE-2.0>

docs/contact.md

@@ -0,0 +1,9 @@
+# Contact Us
+
+For technical support or any type of inquiries, you are very welcome to:
+
+- Reach out to community members on the [**Prowler Slack channel**](https://join.slack.com/t/prowler-workspace/shared_invite/zt-1hix76xsl-2uq222JIXrC7Q8It~9ZNog)
+
+- Open an Issue or a Pull Request in our [**GitHub repository**](https://github.com/prowler-cloud/prowler).
+
+We will appreciate all types of feedback and contribution, Prowler would not be the same without our vibrant community! 😃

docs/getting-started/requirements.md

@@ -0,0 +1,81 @@
+# Requirements
+
+Prowler has been written in Python using the [AWS SDK (Boto3)](https://boto3.amazonaws.com/v1/documentation/api/latest/index.html#) and [Azure SDK](https://learn.microsoft.com/en-us/python/api/overview/azure/?view=azure-python).
+## AWS
+
+Since Prowler uses AWS Credentials under the hood, you can follow any authentication method as described [here](https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-quickstart.html#cli-configure-quickstart-precedence).
+
+### AWS Authentication
+
+Make sure you have properly configured your AWS-CLI with a valid Access Key and Region or declare AWS variables properly (or instance profile/role):
+
+```console
+aws configure
+```
+
+or
+
+```console
+export AWS_ACCESS_KEY_ID="ASXXXXXXX"
+export AWS_SECRET_ACCESS_KEY="XXXXXXXXX"
+export AWS_SESSION_TOKEN="XXXXXXXXX"
+```
+
+Those credentials must be associated to a user or role with proper permissions to do all checks. To make sure, add the following AWS managed policies to the user or role being used:
+
+  - arn:aws:iam::aws:policy/SecurityAudit
+  - arn:aws:iam::aws:policy/job-function/ViewOnlyAccess
+
+  > Moreover, some read-only additional permissions are needed for several checks, make sure you attach also the custom policy [prowler-additions-policy.json](https://github.com/prowler-cloud/prowler/blob/master/iam/prowler-additions-policy.json) to the role you are using.
+
+  > If you want Prowler to send findings to [AWS Security Hub](https://aws.amazon.com/security-hub), make sure you also attach the custom policy [prowler-security-hub.json](https://github.com/prowler-cloud/prowler/blob/master/iam/prowler-security-hub.json).
+
+## Azure
+
+Prowler for azure supports the following authentication types:
+
+- Service principal authentication by environment variables (Enterprise Application)
+- Current az cli credentials stored
+- Interactive browser authentication
+- Managed identity authentication
+
+### Service Principal authentication
+
+To allow Prowler assume the service principal identity to start the scan it is needed to configure the following environment variables:
+
+```console
+export AZURE_CLIENT_ID="XXXXXXXXX"
+export AZURE_TENANT_ID="XXXXXXXXX"
+export AZURE_CLIENT_SECRET="XXXXXXX"
+```
+
+If you try to execute Prowler with the `--sp-env-auth` flag and those variables are empty or not exported, the execution is going to fail.
+### AZ CLI / Browser / Managed Identity authentication
+
+The other three cases does not need additional configuration, `--az-cli-auth` and `--managed-identity-auth` are automated options, `--browser-auth` needs the user to authenticate using the default browser to start the scan.
+
+### Permissions
+
+To use each one you need to pass the proper flag to the execution. Prowler fro Azure handles two types of permission scopes, which are:
+
+- **Azure Active Directory permissions**: Used to retrieve metadata from the identity assumed by Prowler and future AAD checks (not mandatory to have access to execute the tool)
+- **Subscription scope permissions**: Required to launch the checks against your resources, mandatory to launch the tool.
+
+
+#### Azure Active Directory scope
+
+Azure Active Directory (AAD) permissions required by the tool are the following:
+
+- `Directory.Read.All`
+- `Policy.Read.All`
+
+The best way to assign it is through the azure web console:
+
+![AAD Permissions](../img/AAD-permissions.png)
+
+#### Subscriptions scope
+
+Regarding the subscription scope, Prowler by default scans all the subscriptions that is able to list, so it is required to add the following RBAC builtin roles per subscription  to the entity that is going to be assumed by the tool:
+
+- `Security Reader`
+- `Reader`

docs/img/ProwlerPro-icon.svg

@@ -0,0 +1 @@
+<svg id="Layer_1" data-name="Layer 1" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" viewBox="0 0 240.29 285.79"><defs><style>.cls-1{fill:url(#linear-gradient);}.cls-2{fill:#71be44;}</style><linearGradient id="linear-gradient" x1="157.45" y1="97.85" x2="211.7" y2="97.85" gradientUnits="userSpaceOnUse"><stop offset="0" stop-color="#5a9b37"/><stop offset="1" stop-color="#71be44"/></linearGradient></defs><circle class="cls-1" cx="148.2" cy="97.85" r="67.45"/><path class="cls-2" d="M66.28,30.4H148.2a0,0,0,0,1,0,0V185.35a81.93,81.93,0,0,1-81.93,81.93h0a0,0,0,0,1,0,0V30.4A0,0,0,0,1,66.28,30.4Z"/></svg>

docs/index.md

@@ -0,0 +1,125 @@
+<p href="https://github.com/prowler-cloud/prowler">
+<img align="right" src="./img/prowler-logo.png" height="100">
+</p>
+<br>
+
+# Prowler Documentation
+
+Welcome to [Prowler](https://github.com/prowler-cloud/prowler/) Documentation! 📄
+
+- You are currently in the **Getting Started** section where you can find general information and requirements to help you start with the tool.
+- In the [Tutorials](tutorials/overview) section you will see how to take advantage of all the features in Prowler.
+- In the [Contact Us](contact) section you can find how to reach us out in case of technical issues.
+- In the [About](about) section you will find more information about the Prowler team and license.
+
+## About Prowler
+
+**Prowler** is an Open Source security tool to perform AWS and Azure security best practices assessments, audits, incident response, continuous monitoring, hardening and forensics readiness.
+
+It contains hundreds of controls covering CIS, PCI-DSS, ISO27001, GDPR, HIPAA, FFIEC, SOC2, AWS FTR, ENS and custom security frameworks.
+
+## Quick Start
+
+### Installation
+
+Prowler is available as a project in [PyPI](https://pypi.org/project/prowler-cloud/), thus can be installed using pip:
+
+```bash
+pip install prowler-cloud
+prowler -v
+```
+
+## Prowler container versions
+
+The available versions of Prowler are the following:
+
+- latest: in sync with master branch (bear in mind that it is not a stable version)
+- <x.y.z> (release): you can find the releases [here](https://github.com/prowler-cloud/prowler/releases), those are stable releases.
+- stable: this tag always point to the latest release.
+
+The container images are available here:
+
+- [DockerHub](https://hub.docker.com/r/toniblyx/prowler/tags)
+- [AWS Public ECR](https://gallery.ecr.aws/o4g1s5r6/prowler)
+
+## High level architecture
+
+You can run Prowler from your workstation, an EC2 instance, Fargate or any other container, Codebuild, CloudShell and Cloud9.
+
+![Architecture](img/architecture.png)
+## Basic Usage
+
+To run prowler, you will need to specify the provider (e.g aws or azure):
+
+```console
+prowler <provider>
+```
+![Prowler Execution](img/short-display.png)
+> Running the `prowler` command without options will use your environment variable credentials, see [Requirements](getting-started/requirements/) section to review the credentials settings.
+
+By default, prowler will generate a CSV and a JSON report, however you could generate an HTML or an JSON-ASFF report with `-M` or `--output-modes`:
+
+```console
+prowler <provider> -M csv json json-asff html
+```
+
+You can use `-l`/`--list-checks` or `--list-services` to list all available checks or services within the provider.
+
+```console
+prowler <provider> --list-checks
+prowler <provider> --list-services
+```
+
+For executing specific checks or services you can use options `-c`/`checks` or `-s`/`services`:
+
+```console
+prowler azure --checks storage_blob_public_access_level_is_disabled
+prowler aws --services s3 ec2
+```
+
+Also, checks and services can be excluded with options `-e`/`--excluded-checks` or `--excluded-services`:
+
+```console
+prowler aws --excluded-checks s3_bucket_public_access
+prowler azure --excluded-services defender iam
+```
+
+You can always use `-h`/`--help` to access to the usage information and all the possible options:
+
+```console
+prowler -h
+```
+
+### AWS
+
+Use a custom AWS profile with `-p`/`--profile` and/or AWS regions which you want to audit with `-f`/`--filter-region`:
+
+```console
+prowler aws --profile custom-profile -f us-east-1 eu-south-2
+```
+> By default, `prowler` will scan all AWS regions.
+
+### Azure
+
+With Azure you need to specify which auth method is going to be used:
+
+```console
+# To use service principal authentication
+prowler azure --sp-env-auth
+
+# To use az cli authentication
+prowler azure --az-cli-auth
+
+# To use browser authentication
+prowler azure --browser-auth
+
+# To use managed identity auth
+prowler azure --managed-identity-auth
+```
+
+More details in [Requirements](getting-started/requirements.md)
+
+Prowler by default scans all the subscriptions that is allowed to scan, if you want to scan a single subscription or various concrete subscriptions you can use the following flag (using az cli auth as example):
+```console
+prowler azure --az-cli-auth --subscription-ids <subscription ID 1> <subscription ID 2> ... <subscription ID N>
+```

docs/tutorials/allowlist.md

@@ -0,0 +1,76 @@
+# Allowlisting
+Sometimes you may find resources that are intentionally configured in a certain way that may be a bad practice but it is all right with it, for example an AWS S3 Bucket open to the internet hosting a web site, or an AWS Security Group with an open port needed in your use case.
+
+Allowlist option works along with other options and adds a `WARNING` instead of `INFO`, `PASS` or `FAIL` to any output format.
+
+You can use `-w`/`--allowlist-file` with the path of your allowlist yaml file, but first, let's review the syntax.
+
+## Allowlist Yaml File Syntax
+
+    ### Account, Check and/or Region can be * to apply for all the cases
+    ### Resources is a list that can have either Regex or Keywords:
+    ###########################  ALLOWLIST EXAMPLE  ###########################
+    Allowlist:
+    Accounts:
+        "123456789012":
+        Checks:
+            "iam_user_hardware_mfa_enabled":
+            Regions:
+                - "us-east-1"
+            Resources:
+                - "user-1"           # Will ignore user-1 in check iam_user_hardware_mfa_enabled
+                - "user-2"           # Will ignore user-2 in check iam_user_hardware_mfa_enabled
+            "*":
+            Regions:
+                - "*"
+            Resources:
+                - "test"             # Will ignore every resource containing the string "test" in every account and region
+
+        "*":
+        Checks:
+            "s3_bucket_object_versioning":
+            Regions:
+                - "eu-west-1"
+                - "us-east-1"
+            Resources:
+                - "ci-logs"           # Will ignore bucket "ci-logs" AND ALSO bucket "ci-logs-replica" in specified check and regions
+                - "logs"              # Will ignore EVERY BUCKET containing the string "logs" in specified check and regions
+                - "[[:alnum:]]+-logs" # Will ignore all buckets containing the terms ci-logs, qa-logs, etc. in specified check and regions
+
+
+## Supported Allowlist Locations
+
+The allowlisting flag supports the following locations:
+
+### Local file
+You will need to pass the local path where your Allowlist YAML file is located:
+```
+prowler <provider> -w allowlist.yaml
+```
+### AWS S3 URI
+You will need to pass the S3 URI where your Allowlist YAML file was uploaded to your bucket:
+```
+prowler aws -w s3://<bucket>/<prefix>/allowlist.yaml
+```
+> Make sure that the used AWS credentials have s3:GetObject permissions in the S3 path where the allowlist file is located.
+
+### AWS DynamoDB Table ARN
+
+You will need to pass the DynamoDB Allowlist Table ARN:
+
+```
+prowler aws -w arn:aws:dynamodb:<region_name>:<account_id>:table/<table_name>
+```
+
+1. The DynamoDB Table must have the following String keys:
+<img src="/img/allowlist-keys.png"/>
+
+- The Allowlist Table must have the following columns:
+    - Accounts (String): This field can contain either an Account ID or an `*` (which applies to all the accounts that use this table as an allowlist).
+    - Checks (String): This field can contain either a Prowler Check Name or an `*` (which applies to all the scanned checks).
+    - Regions (List): This field contains a list of regions where this allowlist rule is applied (it can also contains an `*` to apply all scanned regions).
+    - Resources (List): This field contains a list of regex expressions that applies to the resources that are wanted to be allowlisted.
+
+<img src="/img/allowlist-row.png"/>
+
+> Make sure that the used AWS credentials have `dynamodb:PartiQLSelect` permissions in the table.

docs/tutorials/aws/organizations.md

@@ -0,0 +1,49 @@
+# AWS Organizations
+## Get AWS Account details from your AWS Organization:
+
+Prowler allows you to get additional information of the scanned account in CSV and JSON outputs. When scanning a single account you get the Account ID as part of the output.
+
+If you have AWS Organizations Prowler can get your account details like Account Name, Email, ARN, Organization ID and Tags and you will have them next to every finding in the CSV and JSON outputs.
+
+- In order to do that you can use the option `-O`/`--organizations-role <organizations_role_arn>`. See the following sample command:
+
+```
+prowler aws -O arn:aws:iam::<management_organizations_account_id>:role/<role_name>
+```
+> Make sure the role in your AWS Organizatiosn management account has the permissions `organizations:ListAccounts*` and `organizations:ListTagsForResource`.
+
+- In that command Prowler will scan the account and getting the account details from the AWS Organizations management account assuming a role and creating two reports with those details in JSON and CSV.
+
+In the JSON output below (redacted) you can see tags coded in base64 to prevent breaking CSV or JSON due to its format:
+
+```json
+  "Account Email": "my-prod-account@domain.com",
+  "Account Name": "my-prod-account",
+  "Account ARN": "arn:aws:organizations::222222222222:account/o-abcde1234/111111111111",
+  "Account Organization": "o-abcde1234",
+  "Account tags": "\"eyJUYWdzIjpasf0=\""
+```
+
+The additional fields in CSV header output are as follow:
+
+```csv
+ACCOUNT_DETAILS_EMAIL,ACCOUNT_DETAILS_NAME,ACCOUNT_DETAILS_ARN,ACCOUNT_DETAILS_ORG,ACCOUNT_DETAILS_TAGS
+```
+
+## Assume Role and across all accounts in AWS Organizations or just a list of accounts:
+
+If you want to run Prowler across all accounts of AWS Organizations you can do this:
+
+- First get a list of accounts that are not suspended:
+
+```
+ACCOUNTS_IN_ORGS=$(aws organizations list-accounts --query Accounts[?Status==`ACTIVE`].Id --output text)
+```
+
+- Then run Prowler to assume a role (same in all members) per each account, in this example it is just running one particular check:
+
+```
+for accountId in $ACCOUNTS_IN_ORGS; do prowler aws -O arn:aws:iam::<management_organizations_account_id>:role/<role_name>; done
+```
+
+- Using the same for loop it can be scanned a list of accounts with a variable like `ACCOUNTS_LIST='11111111111 2222222222 333333333'`

docs/tutorials/aws/role-assumption.md

@@ -0,0 +1,24 @@
+# AWS Assume Role
+
+Prowler uses the AWS SDK (Boto3) underneath so it uses the same authentication methods.
+
+However, there are few ways to run Prowler against multiple accounts using IAM Assume Role feature depending on each use case:
+
+1. You can just set up your custom profile inside `~/.aws/config` with all needed information about the role to assume then call it with `prowler aws -p/--profile your-custom-profile`.
+
+2. You can use `-R`/`--role <role_arn>` and Prowler will get those temporary credentials using `aws sts assume-role`, set them up as environment variables and run against that given account.
+```sh
+prowler aws -R arn:aws:iam::<account_id>:role/<role_name>
+```
+- Optionally, the session duration (in seconds, by deafult 3600) and the external ID of this role assumption can be defined:
+
+```sh
+prowler aws -T/--session-duration <seconds> -I/--external-id <external_id> -R arn:aws:iam::<account_id>:role/<role_name>
+```
+
+>To create a role to assume in multiple accounts easier either as CFN Stack or StackSet, look at [this CloudFormation template](iam/create_role_to_assume_cfn.yaml) and adapt it.
+
+
+> _NOTE 1 about Session Duration_: Depending on the mount of checks you run and the size of your infrastructure, Prowler may require more than 1 hour to finish. Use option `-T <seconds>` to allow up to 12h (43200 seconds). To allow more than 1h you need to modify _"Maximum CLI/API session duration"_ for that particular role, read more [here](https://docs.aws.amazon.com/IAM/latest/UserGuide/id_roles_use.html#id_roles_use_view-role-max-session).
+
+> _NOTE 2 about Session Duration_: Bear in mind that if you are using roles assumed by role chaining there is a hard limit of 1 hour so consider not using role chaining if possible, read more about that, in foot note 1 below the table [here](https://docs.aws.amazon.com/IAM/latest/UserGuide/id_roles_use.html).

docs/tutorials/aws/securityhub.md

@@ -0,0 +1,38 @@
+# Security Hub Integration
+
+Prowler supports natively and as **official integration** sending findings to [AWS Security Hub](https://aws.amazon.com/security-hub). This integration allows Prowler to import its findings to AWS Security Hub.
+
+With Security Hub, you now have a single place that aggregates, organizes, and prioritizes your security alerts, or findings, from multiple AWS services, such as Amazon GuardDuty, Amazon Inspector, Amazon Macie, AWS Identity and Access Management (IAM) Access Analyzer, and AWS Firewall Manager, as well as from AWS Partner solutions and from Prowler for free.
+
+Before sending findings to Prowler, you will need to perform next steps:
+
+1. Since Security Hub is a region based service, enable it in the region or regions you require. Use the AWS Management Console or using the AWS CLI with this command if you have enough permissions:
+    - `aws securityhub enable-security-hub --region <region>`.
+2. Enable Prowler as partner integration integration. Use the AWS Management Console or using the AWS CLI with this command if you have enough permissions:
+    - `aws securityhub enable-import-findings-for-product --region <region> --product-arn arn:aws:securityhub:<region>::product/prowler/prowler` (change region also inside the ARN).
+    - Using the AWS Management Console:
+     ![Screenshot 2020-10-29 at 10 26 02 PM](https://user-images.githubusercontent.com/3985464/97634660-5ade3400-1a36-11eb-9a92-4a45cc98c158.png)
+3. Allow Prowler to import its findings to AWS Security Hub by adding the policy below to the role or user running Prowler:
+    - [iam/prowler-security-hub.json](iam/prowler-security-hub.json)
+
+Once it is enabled, it is as simple as running the command below (for all regions):
+
+```sh
+./prowler aws -S
+```
+
+or for only one filtered region like eu-west-1:
+
+```sh
+./prowler -S -f eu-west-1
+```
+
+> **Note 1**: It is recommended to send only fails to Security Hub and that is possible adding `-q` to the command.
+
+> **Note 2**: Since Prowler perform checks to all regions by defauls you may need to filter by region when runing Security Hub integration, as shown in the example above. Remember to enable Security Hub in the region or regions you need by calling `aws securityhub enable-security-hub --region <region>` and run Prowler with the option `-f <region>` (if no region is used it will try to push findings in all regions hubs).
+
+> **Note 3** to have updated findings in Security Hub you have to run Prowler periodically. Once a day or every certain amount of hours.
+
+Once you run findings for first time you will be able to see Prowler findings in Findings section:
+
+![Screenshot 2020-10-29 at 10 29 05 PM](https://user-images.githubusercontent.com/3985464/97634676-66c9f600-1a36-11eb-9341-70feb06f6331.png)

docs/tutorials/azure/authentication.md

@@ -0,0 +1,27 @@
+# Azure authentication
+
+By default prowler uses Azure Python SDK identity package authentication methods using the classes `DefaultAzureCredential` and `InteractiveBrowserCredential`.  
+This allows Prowler to authenticate against azure using the following methods:
+
+- Service principal authentication by environment variables (Enterprise Application)  
+- Current az cli credentials stored  
+- Interactive browser authentication  
+- Managed identity authentication  
+
+To launch the tool it is required to specify which method is used through the following flags:
+
+```console
+# To use service principal authentication
+prowler azure --sp-env-auth
+
+# To use az cli authentication
+prowler azure --az-cli-auth
+
+# To use browser authentication
+prowler azure --browser-auth
+
+# To use managed identity auth
+prowler azure --managed-identity-auth
+```
+
+To use Prowler you need to set up also the permissions required to access your resources in your Azure account, to more details refer to [Requirements](getting-started/requirements.md)  

docs/tutorials/azure/subscriptions.md

@@ -0,0 +1,10 @@
+# Azure subscriptions scope
+
+By default Prowler is multisubscription, which means that is going to scan all the subscriptions is able to list. If you only assign permissions to one subscription it is going to scan a single one.  
+Prowler also has the ability to limit the subscriptions to scan to a set passed as input argument, to do so:
+
+```console
+prowler azure --az-cli-auth --subscription-ids <subscription ID 1> <subscription ID 2> ... <subscription ID N>
+```
+
+Where you can pass from 1 up to N subscriptions to be scanned.

docs/tutorials/compliance.md

@@ -0,0 +1,3 @@
+  --list-compliance     List compliance frameworks
+  --list-compliance-requirements [{ens_rd2022_aws}]
+--compliance {ens_rd2022_aws} [{ens_rd2022_aws} ...]

docs/tutorials/logging.md

@@ -0,0 +1,48 @@
+# Logging
+
+Prowler has a logging feature to be as transparent as possible so you can see every action that is going on will the tool is been executing.
+
+## Set Log Level
+
+There are different log levels depending on the logging information that is desired to be displayed:
+
+- **DEBUG**: it will show low-level logs of Python.
+- **INFO**: it will show all the API Calls that are being used in the provider.
+- **WARNING**: it will show the resources that are being **allowlisted**.
+- **ERROR**: it will show the errors, e.g., not authorized actions.
+- **CRITICAL**: default log level, if a critical log appears, it will **exit** Prowler’s execution.
+
+You can establish the log level of Prowler with `--log-level` option:
+
+```console
+prowler <provider> --log-level {DEBUG,INFO,WARNING,ERROR,CRITICAL}
+```
+
+> By default, Prowler will run with the `CRITICAL` log level, since critical errors will abort the execution.
+
+## Export Logs to File
+
+Prowler allows you to export the logs in json format with `--log-file` option:
+
+```console
+prowler <provider> --log-level {DEBUG,INFO,WARNING,ERROR,CRITICAL} --log-file <file_name>.json
+```
+
+An example of a log file will be the following:
+
+    {
+        "timestamp": "2022-12-01 16:45:56,399",
+        "filename": "ec2_service.py:114",
+        "level": "ERROR",
+        "module": "ec2_service",
+        "message": "eu-west-2 -- ClientError[102]: An error occurred (UnauthorizedOperation) when calling the DescribeSecurityGroups operation: You are not authorized to perform this operation."
+    }
+    {
+        "timestamp": "2022-12-01 16:45:56,438",
+        "filename": "ec2_service.py:134",
+        "level": "ERROR",
+        "module": "ec2_service",
+        "message": "eu-west-2 -- ClientError[124]: An error occurred (UnauthorizedOperation) when calling the DescribeNetworkAcls operation: You are not authorized to perform this operation."
+    }
+
+> NOTE: Each finding is a `json` object.

docs/tutorials/misc.md

@@ -0,0 +1,106 @@
+# Miscellaneous
+## Prowler Version
+Show Prowler version:
+```console
+prowler <provider> -V/-v/--version
+```
+## Verbose
+Execute Prowler in verbose mode (like in Version 2):
+```console
+prowler <provider> --verbose
+```
+## Show only Fails
+Prowler can only display the failed findings:
+```console
+prowler <provider> -q/--quiet
+```
+## Hide Prowler Banner
+Prowler can run without showing its banner:
+```console
+prowler <provider> -b/--no-banner
+```
+## Checks
+Prowler has checks per provider, there are options related with them:
+
+- List the available checks in the provider:
+```console
+prowler <provider> --list-checks
+```
+- Execute specific check(s):
+```console
+prowler <provider> -c/--checks s3_bucket_public_access
+```
+- Exclude specific check(s):
+```console
+prowler <provider> -e/--excluded-checks ec2 rds
+```
+- Execute checks that appears in a json file:
+```json
+<checks_list>.json
+
+{
+    "<provider>": [
+        "<check_name_1",
+        "<check_name_2",
+        "<check_name_3",
+        ...
+    ],
+    ...
+}
+```
+```console
+prowler <provider> -C/--checks-file <checks_list>.json
+```
+
+## Severities
+Each check of Prowler has a severity, there are options related with it:
+
+- List the available checks in the provider:
+```console
+prowler <provider> --list-severities
+```
+- Execute specific severity(s):
+```console
+prowler <provider> --severity critical high
+```
+
+## Service
+Prowler has services per provider, there are options related with them:
+
+- List the available services in the provider:
+```console
+prowler <provider> --list-services
+```
+- Execute specific service(s):
+```console
+prowler <provider> -s/--services s3 iam
+```
+- Exclude specific service(s):
+```console
+prowler <provider> --excluded-services ec2 rds
+```
+
+## Categories
+Prowler groups checks in different categories, there are options related with them:
+
+- List the available categories in the provider:
+```console
+prowler <provider> --list-categories
+```
+- Execute specific category(s):
+```console
+prowler  <provider> --categories
+```
+
+## AWS
+
+### Scan specific AWS Region
+Prowler can scan specific region(s) with:
+```console
+prowler <provider> -f/--filter-region eu-west-1 us-east-1
+```
+### Use AWS Profile
+Prowler can use your custom AWS Profile with:
+```console
+prowler <provider> -p/--profile <profile_name>
+```

docs/tutorials/pentesting.md

@@ -0,0 +1,69 @@
+# Pentesting
+
+Prowler has some checks that analyse pentesting risks (Secrets, Internet Exposed, AuthN, AuthZ and more).
+
+## Detect Secrets
+
+Prowler uses `detect-secrets` library to search for any secrets that are stores in plaintext within your environment.
+
+The actual checks that have this funcionality are:
+
+1. autoscaling_find_secrets_ec2_launch_configuration
+- awslambda_function_no_secrets_in_code
+- awslambda_function_no_secrets_in_variables
+- cloudformation_outputs_find_secrets
+- ec2_instance_secrets_user_data
+- ecs_task_definitions_no_environment_secrets
+- ssm_document_secrets
+
+To execute detect-secrets related checks, you can run the following command:
+
+```console
+prowler <provider> --categories secrets
+```
+## Internet Exposed Resources
+
+Several checks analyse resources that are exposed to the Internet, these are:
+
+1. apigateway_endpoint_public
+- appstream_fleet_default_internet_access_disabled
+- awslambda_function_not_publicly_accessible
+- ec2_ami_public
+- ec2_ebs_public_snapshot
+- ec2_instance_internet_facing_with_instance_profile
+- ec2_instance_public_ip
+- ec2_networkacl_allow_ingress_any_port
+- ec2_securitygroup_allow_ingress_from_internet_to_any_port
+- ec2_securitygroup_allow_wide_open_public_ipv4
+- ec2_securitygroup_in_use_without_ingress_filtering
+- ecr_repositories_not_publicly_accessible
+- eks_control_plane_endpoint_access_restricted
+- eks_endpoints_not_publicly_accessible
+- eks_control_plane_endpoint_access_restricted
+- eks_endpoints_not_publicly_accessible
+- elbv2_internet_facing
+- kms_key_not_publicly_accessible
+- opensearch_service_domains_not_publicly_accessible
+- rds_instance_no_public_access
+- rds_snapshots_public_access
+- s3_bucket_policy_public_write_access
+- s3_bucket_public_access
+- sagemaker_notebook_instance_without_direct_internet_access_configured
+- sns_topics_not_publicly_accessible
+- sqs_queues_not_publicly_accessible
+
+...
+
+To execute internet-exposed related checks, you can run the following command:
+
+```console
+prowler <provider> --categories internet-exposed
+```
+
+### Shodan
+
+Prowler allows you check if any elastic ip in your AWS Account is exposed in Shodan with `-N`/`--shodan <shodan_api_key>` option:
+
+```console
+prowler aws --shodan <shodan_api_key> -c ec2_elastic_ip_shodan
+```

docs/tutorials/reporting.md

@@ -0,0 +1,231 @@
+# Reporting
+
+By default, Prowler will generate a CSV and a JSON report, however you could generate an HTML or an JSON-ASFF report with `-M` or `--output-modes`:
+
+```console
+prowler <provider> -M csv json json-asff html
+```
+
+## Custom Output Flags
+By default, Prowler creates a file inside the `output` directory named `prowler-output-ACCOUNT_NUM-OUTPUT_DATE.format`.
+
+However, both the output file name and directory can be personalised:
+
+- Custom output report name: you can use the flag `-F`/`--output-filename`
+```console
+prowler <provider> -M csv json json-asff html -F <custom_report_name>
+```
+- Custom output directory: you can use the flag `-o`/`--output-directory`
+```console
+prowler <provider> -M csv json json-asff html -o <custom_report_directory>
+```
+> Both flags can be used simultainously to provide a custom directory and filename.
+```console
+prowler <provider> -M csv json json-asff html -F <custom_report_name> -o <custom_report_directory>
+```
+## Send report to AWS S3 Bucket
+
+To save your report in an S3 bucket, use `-B`/`--output-bucket` to define a custom output bucket along with `-M` to define the output format that is going to be uploaded to S3:
+
+```sh
+prowler <provider> -M csv -B my-bucket/folder/
+```
+
+> In the case you do not want to use the assumed role credentials but the initial credentials to put the reports into the S3 bucket, use `-D`/`--output-bucket-no-assume` instead of `-B`/`--output-bucket.
+
+> Make sure that the used credentials have s3:PutObject permissions in the S3 path where the reports are going to be uploaded.
+
+## Output Formats
+
+Prowler supports natively the following output formats:
+
+- CSV
+- JSON
+- JSON-ASFF
+- HTML
+
+Hereunder is the structure for each of the supported report formats by Prowler:
+
+### CSV
+| ASSESSMENT_START_TIME | FINDING_UNIQUE_ID | PROVIDER | PROFILE | ACCOUNT_ID | ACCOUNT_NAME | ACCOUNT_EMAIL | ACCOUNT_ARN | ACCOUNT_ORG | ACCOUNT_TAGS | REGION | CHECK_ID | CHECK_TITLE | CHECK_TYPE | STATUS | STATUS_EXTENDED | SERVICE_NAME | SUBSERVICE_NAME | SEVERITY | RESOURCE_ID | RESOURCE_ARN | RESOURCE_TYPE | RESOURCE_DETAILS | RESOURCE_TAGS | DESCRIPTION | RISK | RELATED_URL | REMEDIATION_RECOMMENDATION_TEXT | REMEDIATION_RECOMMENDATION_URL | REMEDIATION_RECOMMENDATION_CODE_NATIVEIAC | REMEDIATION_RECOMMENDATION_CODE_TERRAFORM | REMEDIATION_RECOMMENDATION_CODE_CLI | REMEDIATION_RECOMMENDATION_CODE_OTHER | CATEGORIES | DEPENDS_ON | RELATED_TO | NOTES |
+| ------- | ----------- | ------ | -------- | ------------ | ----------- | ---------- | ---------- | --------------------- | -------------------------- | -------------- | ----------------- | ------------------------ | --------------- | ---------- | ----------------- | --------- | -------------- | ----------------- | ------------------ | --------------------- | -------------------- | ------------------- | ------------------- | -------------------- | -------------------- | -------------------- | -------------------- | -------------------- | -------------------- | -------------------- | -------------------- | -------------------- | -------------------- | -------------------- | -------------------- | -------------------- |
+
+### JSON
+
+```
+[{
+    "AssessmentStartTime": "2022-12-01T14:16:57.354413",
+    "FindingUniqueId": "",
+    "Provider": "aws",
+    "Profile": "dev",
+    "AccountId": "ACCOUNT_ID",
+    "OrganizationsInfo": null,
+    "Region": "eu-west-1",
+    "CheckID": "rds_instance_minor_version_upgrade_enabled",
+    "CheckTitle": "Ensure RDS instances have minor version upgrade enabled.",
+    "CheckType": [],
+    "ServiceName": "rds",
+    "SubServiceName": "",
+    "Status": "PASS",
+    "StatusExtended": "RDS Instance rds-instance-id has minor version upgrade enabled.",
+    "Severity": "low",
+    "ResourceId": "rds-instance-id",
+    "ResourceArn": "",
+    "ResourceType": "AwsRdsDbInstance",
+    "ResourceDetails": "",
+    "Tags": {
+        "Tag1Key": "value",
+        "Tag2Key": "value"
+    },
+    "Description": "Ensure RDS instances have minor version upgrade enabled.",
+    "Risk": "Auto Minor Version Upgrade is a feature that you can enable to have your database automatically upgraded when a new minor database engine version is available. Minor version upgrades often patch security vulnerabilities and fix bugs and therefore should be applied.",
+    "RelatedUrl": "https://aws.amazon.com/blogs/database/best-practices-for-upgrading-amazon-rds-to-major-and-minor-versions-of-postgresql/",
+    "Remediation": {
+        "Code": {
+            "NativeIaC": "https://docs.bridgecrew.io/docs/ensure-aws-db-instance-gets-all-minor-upgrades-automatically#cloudformation",
+            "Terraform": "https://docs.bridgecrew.io/docs/ensure-aws-db-instance-gets-all-minor-upgrades-automatically#terraform",
+            "CLI": "aws rds modify-db-instance --db-instance-identifier <db_instance_id> --auto-minor-version-upgrade --apply-immediately",
+            "Other": "https://www.trendmicro.com/cloudoneconformity/knowledge-base/aws/RDS/rds-auto-minor-version-upgrade.html"
+        },
+        "Recommendation": {
+            "Text": "Enable auto minor version upgrade for all databases and environments.",
+            "Url": "https://aws.amazon.com/blogs/database/best-practices-for-upgrading-amazon-rds-to-major-and-minor-versions-of-postgresql/"
+        }
+    },
+    "Categories": [],
+    "DependsOn": [],
+    "RelatedTo": [],
+    "Notes": ""
+},{
+    "AssessmentStartTime": "2022-12-01T14:16:57.354413",
+    "FindingUniqueId": "",
+    "Provider": "aws",
+    "Profile": "dev",
+    "AccountId": "ACCOUNT_ID",
+    "OrganizationsInfo": null,
+    "Region": "eu-west-1",
+    "CheckID": "rds_instance_minor_version_upgrade_enabled",
+    "CheckTitle": "Ensure RDS instances have minor version upgrade enabled.",
+    "CheckType": [],
+    "ServiceName": "rds",
+    "SubServiceName": "",
+    "Status": "PASS",
+    "StatusExtended": "RDS Instance rds-instance-id has minor version upgrade enabled.",
+    "Severity": "low",
+    "ResourceId": "rds-instance-id",
+    "ResourceArn": "",
+    "ResourceType": "AwsRdsDbInstance",
+    "ResourceDetails": "",
+    "Tags": {
+        "Tag1Key": "value",
+        "Tag2Key": "value"
+    },
+    "Description": "Ensure RDS instances have minor version upgrade enabled.",
+    "Risk": "Auto Minor Version Upgrade is a feature that you can enable to have your database automatically upgraded when a new minor database engine version is available. Minor version upgrades often patch security vulnerabilities and fix bugs and therefore should be applied.",
+    "RelatedUrl": "https://aws.amazon.com/blogs/database/best-practices-for-upgrading-amazon-rds-to-major-and-minor-versions-of-postgresql/",
+    "Remediation": {
+        "Code": {
+            "NativeIaC": "https://docs.bridgecrew.io/docs/ensure-aws-db-instance-gets-all-minor-upgrades-automatically#cloudformation",
+            "Terraform": "https://docs.bridgecrew.io/docs/ensure-aws-db-instance-gets-all-minor-upgrades-automatically#terraform",
+            "CLI": "aws rds modify-db-instance --db-instance-identifier <db_instance_id> --auto-minor-version-upgrade --apply-immediately",
+            "Other": "https://www.trendmicro.com/cloudoneconformity/knowledge-base/aws/RDS/rds-auto-minor-version-upgrade.html"
+        },
+        "Recommendation": {
+            "Text": "Enable auto minor version upgrade for all databases and environments.",
+            "Url": "https://aws.amazon.com/blogs/database/best-practices-for-upgrading-amazon-rds-to-major-and-minor-versions-of-postgresql/"
+        }
+    },
+    "Categories": [],
+    "DependsOn": [],
+    "RelatedTo": [],
+    "Notes": ""
+}]
+```
+
+> NOTE: Each finding is a `json` object.
+
+### JSON-ASFF
+
+```
+[{
+    "SchemaVersion": "2018-10-08",
+    "Id": "prowler-rds_instance_minor_version_upgrade_enabled-ACCOUNT_ID-eu-west-1-b1ade474a",
+    "ProductArn": "arn:aws:securityhub:eu-west-1::product/prowler/prowler",
+    "RecordState": "ACTIVE",
+    "ProductFields": {
+        "ProviderName": "Prowler",
+        "ProviderVersion": "3.0-beta-21Nov2022",
+        "ProwlerResourceName": "rds-instance-id"
+    },
+    "GeneratorId": "prowler-rds_instance_minor_version_upgrade_enabled",
+    "AwsAccountId": "ACCOUNT_ID",
+    "Types": [],
+    "FirstObservedAt": "2022-12-01T13:16:57Z",
+    "UpdatedAt": "2022-12-01T13:16:57Z",
+    "CreatedAt": "2022-12-01T13:16:57Z",
+    "Severity": {
+        "Label": "LOW"
+    },
+    "Title": "Ensure RDS instances have minor version upgrade enabled.",
+    "Description": "Ensure RDS instances have minor version upgrade enabled.",
+    "Resources": [
+        {
+            "Type": "AwsRdsDbInstance",
+            "Id": "rds-instance-id",
+            "Partition": "aws",
+            "Region": "eu-west-1"
+        }
+    ],
+    "Compliance": {
+        "Status": "PASSED",
+        "RelatedRequirements": []
+    },
+    "Remediation": {
+        "Recommendation": {
+            "Text": "Enable auto minor version upgrade for all databases and environments.",
+            "Url": "https://aws.amazon.com/blogs/database/best-practices-for-upgrading-amazon-rds-to-major-and-minor-versions-of-postgresql/"
+        }
+    }
+},{
+    "SchemaVersion": "2018-10-08",
+    "Id": "prowler-rds_instance_minor_version_upgrade_enabled-ACCOUNT_ID-eu-west-1-06d21d75e",
+    "ProductArn": "arn:aws:securityhub:eu-west-1::product/prowler/prowler",
+    "RecordState": "ACTIVE",
+    "ProductFields": {
+        "ProviderName": "Prowler",
+        "ProviderVersion": "3.0-beta-21Nov2022",
+        "ProwlerResourceName": "rds-instance-id"
+    },
+    "GeneratorId": "prowler-rds_instance_minor_version_upgrade_enabled",
+    "AwsAccountId": "ACCOUNT_ID",
+    "Types": [],
+    "FirstObservedAt": "2022-12-01T13:16:57Z",
+    "UpdatedAt": "2022-12-01T13:16:57Z",
+    "CreatedAt": "2022-12-01T13:16:57Z",
+    "Severity": {
+        "Label": "LOW"
+    },
+    "Title": "Ensure RDS instances have minor version upgrade enabled.",
+    "Description": "Ensure RDS instances have minor version upgrade enabled.",
+    "Resources": [
+        {
+            "Type": "AwsRdsDbInstance",
+            "Id": "rds-instance-id",
+            "Partition": "aws",
+            "Region": "eu-west-1"
+        }
+    ],
+    "Compliance": {
+        "Status": "PASSED",
+        "RelatedRequirements": []
+    },
+    "Remediation": {
+        "Recommendation": {
+            "Text": "Enable auto minor version upgrade for all databases and environments.",
+            "Url": "https://aws.amazon.com/blogs/database/best-practices-for-upgrading-amazon-rds-to-major-and-minor-versions-of-postgresql/"
+        }
+    }
+}]
+```
+
+> NOTE: Each finding is a `json` object.