Related Content #
- Code Coverage for Websites
This video shows how to collect code coverage information for a website, instead of unit tests for which this is normally used.
Code coverage tells you which lines of script (or set of scripts) have been executed during a request. With this information you can for example find out how good your unit tests are.
Xdebug's code coverage functionality is often used in combination with PHP_CodeCoverage as part of PHPUnit runs. PHPUnit delegates the code coverage collection to Xdebug. It starts and stops code coverage through xdebug_start_code_coverage() and xdebug_stop_code_coverage() for every test, and uses xdebug_get_code_coverage() to retrieve the results.
Code coverage's main output is an array detailing which lines in which files have been "hit" while running the code with code coverage collection active. But the code coverage functionality can also, with an additional performance impact, analyse which lines of code have executable code on it, which lines of code can actually be hit (dead code analysis), and also can it do instrumentation to find out which branches and paths in functions and methods have been followed. The various options are documented with the xdebug_start_code_coverage() function.
Xdebug 2.6 introduces filtering capabilities for code coverage. With a filter
you can include, or exclude, paths or class name prefixes (namespaces) from
being analysed during code coverage collection. A
typyical use case would be to configure the filter to only include your
src/
folder, so that Xdebug's code coverage analysis does not try
to analyse tests, Composer dependencies, or PHPUnit/PHP_CodeCoverage itself. If
you configure the filter correctly, you can expect a 2-fold speed increase for
code coverage runs
[1,
2,
3].
The filter works by tagging each executable unit (function, method, file) according to the configured filter. Xdebug can only do that the first time a specific executable unit is included/required, as the filtering happens when PHP parses and compiles a file for the first time. Xdebug needs to do it as this point, as this is also when it analyses which paths can run, and which lines of an executable unit can not be executed. Tagging executable units at this point, also means that the filter does not have to run every time Xdebug wants to count a line to be included in code coverage for example. It is therefore important to set-up the filter before the code is included/required. This currently can be best done through an auto-prepended file through PHP's auto_prepend_file setting.
To set-up a filter that only does code coverage analysis for the
src/
folder, you would call xdebug_set_filter() with:
<?php
xdebug_set_filter(
XDEBUG_FILTER_CODE_COVERAGE,
XDEBUG_PATH_INCLUDE,
[ __DIR__ . DIRECTORY_SEPARATOR . "src" . DIRECTORY_SEPARATOR ]
);
?>
With this filter set up, the code coverage information will only include
functions, methods and files which are located in the src/
sub-directory of the file in which this file resides. You can tell PHP to add
this prepend file by calling:
php -dauto_prepend_file=xdebug_filter.php yourscript.php
Or in combination with PHPUnit, when installed through Composer, with:
php -dauto_prepend_file=xdebug_filter.php vendor/bin/phpunit
The full documentation for the arguments to xdebug_set_filter() are described on its own documentation page.
This video shows how to collect code coverage information for a website, instead of unit tests for which this is normally used.
Configures Xdebug's log file.
Xdebug will log to this file all file creations issues, Step Debugging connection attempts, failures, and debug communication.
Enable this functionality by setting the value to a absolute path. Make sure
that the system user that PHP runs at (such as www-data
if you are
running with Apache) can create and write to the file.
The file is opened in append-mode, and will therefore not be overwritten by default. There is no concurrency protection available.
The log file will include any attempt that Xdebug makes to connect to an IDE:
[2693358] Log opened at 2020-09-02 07:19:09.616195 [2693358] [Step Debug] INFO: Connecting to configured address/port: localhost:9003. [2693358] [Step Debug] ERR: Could not connect to debugging client. Tried: localhost:9003 (through xdebug.client_host/xdebug.client_port). [2693358] [Profiler] ERR: File '/foo/cachegrind.out.2693358' could not be opened. [2693358] [Profiler] WARN: /foo: No such file or directory [2693358] [Tracing] ERR: File '/foo/trace.1485761369' could not be opened. [2693358] [Tracing] WARN: /foo: No such file or directory [2693358] Log closed at 2020-09-02 07:19:09.617510
It includes the opening time (2020-09-02 07:19:09.616195
), the
IP/Hostname and port Xdebug is trying to connect to
(localhost:9003
), and whether it succeeded (Connected to
client
). The number in brackets ([2693358]
) is the
Process ID.
It includes:
[2693358]
2020-09-02 07:19:09.616195
For Step Debugging:
INFO: Connecting to configured address/port: localhost:9003. ERR: Could not connect to debugging client. Tried: localhost:9003 (through xdebug.client_host/xdebug.client_port).
For Profiling:
ERR: File '/foo/cachegrind.out.2693358' could not be opened. WARN: /foo: No such file or directory
For Function Trace:
ERR: File '/foo/trace.1485761369' could not be opened. WARN: /foo: No such file or directory
All warnings and errors are described on the Description of errors page, with
detailed instructions on how to resolve the problem, if possible. All errors are always logged through
PHP's internal logging mechanism (configured with error_log
in php.ini
). All warnings and errors also show up in the
diagnostics log that you can view by calling xdebug_info().
The debugging log can also log the communication between Xdebug and an IDE.
This communication is in XML, and starts with the <init
XML
element:
<init xmlns="urn:debugger_protocol_v1" xmlns:xdebug="https://xdebug.org/dbgp/xdebug" fileuri="file:///home/httpd/www.xdebug.org/html/router.php" language="PHP" xdebug:language_version="7.4.11-dev" protocol_version="1.0" appid="2693358" idekey="XDEBUG_ECLIPSE"> <engine version="3.0.0-dev"><![CDATA[Xdebug]]></engine> <author><![CDATA[Derick Rethans]]></author> <url><![CDATA[https://xdebug.org]]></url> <copyright><![CDATA[Copyright (c) 2002-2020 by Derick Rethans]]></copyright> </init>
The fileuri
attribute lists the entry point of your
application, which can be useful to compare to breakpoint_set
commands to see if path mappings are set-up correctly.
Beyond the <init
element, you will find the configuration of
features:
<- feature_set -i 4 -n extended_properties -v 1 -> <response xmlns="urn:debugger_protocol_v1" xmlns:xdebug="https://xdebug.org/dbgp/xdebug" command="feature_set" transaction_id="4" feature="extended_properties" success="1"> </response>
<- step_into -i 9 -> <response xmlns="urn:debugger_protocol_v1" xmlns:xdebug="https://xdebug.org/dbgp/xdebug" command="step_into" transaction_id="9" status="break" reason="ok"> <xdebug:message filename="file:///home/httpd/www.xdebug.org/html/router.php" lineno="3"> </xdebug:message> </response>
You can read about DBGP - A common debugger protocol specification at its dedicated documation page.
The xdebug.log_level setting controls how much information is logged.
Many Linux distributions now use systemd, which
implements private tmp directories. This means that when PHP
is run through a web server or as PHP-FPM, the /tmp
directory is
prefixed with something akin to:
/tmp/systemd-private-ea3cfa882b4e478993e1994033fc5feb-apache.service-FfWZRg
This setting can additionally be configured through the
XDEBUG_CONFIG
environment variable.
Configures which logging messages should be added to the log file.
The log file is configured with the xdebug.log setting.
The following levels are supported:
Level | Name | Example |
---|---|---|
0 | Criticals | Errors in the configuration |
1 | Errors | Connection errors |
3 | Warnings | Connection warnings |
5 | Communication | Protocol messages |
7 | Information | Information while connecting |
10 | Debug | Breakpoint resolving information |
Criticals, errors, and warnings always show up in the diagnostics log that you can view by calling xdebug_info().
Criticals and errors are additionally logged through
PHP's internal logging mechanism (configured with error_log
in php.ini
).
This setting can additionally be configured through the
XDEBUG_CONFIG
environment variable.
This setting controls which Xdebug features are enabled.
This setting can only be set in php.ini
or
files like 99-xdebug.ini
that are read when a PHP process starts
(directly, or through php-fpm). You can not set this value in
.htaccess
and .user.ini
files, which are read
per-request, nor through php_admin_value
as used in Apache VHOSTs
and PHP-FPM pools.
The following values are accepted:
off
develop
coverage
debug
gcstats
profile
trace
You can enable multiple modes at the same time by comma separating their
identifiers as value to xdebug.mode: xdebug.mode=develop,trace
.
You can also set Xdebug's mode by setting the XDEBUG_MODE
environment variable on the command-line; this will take precedence over the
xdebug.mode setting, but will not change the value of the xdebug.mode
setting.
Some web servers have a configuration option to
prevent environment variables from being propagated to PHP and Xdebug.
For example, PHP-FPM has a clear_env
configuration setting that is on
by default, which you will
need to turn off
if you want to use XDEBUG_MODE
.
Make sure that your web server does not clean the environment, or specifically
allows the XDEBUG_MODE
environment variable to be passed on.
Returns whether code coverage is active
Returns whether code coverage has been started.
<?php
var_dump(xdebug_code_coverage_started());
xdebug_start_code_coverage();
var_dump(xdebug_code_coverage_started());
?>
bool(false) bool(true)
Returns code coverage information
Returns a structure which contains information about which lines were executed in your script (including include files). The following example shows code coverage for one specific file:
<?php
xdebug_start_code_coverage(XDEBUG_CC_UNUSED | XDEBUG_CC_DEAD_CODE);
function a($a) {
return;
echo $a * 2.5;
}
function b($count) {
if ($count > 25) {
echo "too much\n";
}
for ($i = 0; $i < $count; $i++) {
a($i + 0.17);
}
}
b(6);
b(10);
var_dump(xdebug_get_code_coverage());
?>
array '/home/httpd/html/test/xdebug/docs/xdebug_get_code_coverage.php' => array (size=11) 5 => int 1 6 => int -2 7 => int -2 10 => int 1 11 => int -1 13 => int 1 14 => int 1 16 => int 1 18 => int 1 19 => int 1 21 => int 1
The information that is collected consists of an two dimensional array with as primary index the executed filename and as secondary key the line number. The value in the elements represents whether the line has been executed or whether it has unreachable lines.
The returned values for each line are:
1
: this line was executed-1
: this line was not executed-2
: this line did not have executable code on it-1
is only returned when the XDEBUG_CC_UNUSED
is enabled and value -2
is only returned when both
XDEBUG_CC_UNUSED
and XDEBUG_CC_DEAD_CODE
are enabled
when starting Code Coverage Analysis through xdebug_start_code_coverage().
If path and branch checking has been enabled with the
XDEBUG_CC_BRANCH_CHECK
flag to xdebug_start_code_coverage()
then the returned format is different. The lines array is returned in
a sub-array element lines
, and separate information is returned
for each function in the functions
element.
The following example illustrates that.
<?php
xdebug_start_code_coverage(XDEBUG_CC_UNUSED | XDEBUG_CC_DEAD_CODE);
function c($count) {
for ($i = 0; $i < $count; $i++) {
$i += 0.17;
}
}
c(10);
var_dump(xdebug_get_code_coverage());
?>
array (size=1) '/tmp/foo2.php' => array (size=2) 'lines' => array (size=5) 5 => int 1 6 => int 1 8 => int 1 10 => int 1 12 => int 1 'functions' => array (size=1) 'c' => array (size=2) 'branches' => array (size=4) 0 => array (size=7) 'op_start' => int 0 'op_end' => int 4 'line_start' => int 4 'line_end' => int 5 'hit' => int 1 'out' => array (size=1) 0 => int 9 'out_hit' => array (size=1) 0 => int 1 5 => array (size=7) 'op_start' => int 5 'op_end' => int 8 'line_start' => int 6 'line_end' => int 5 'hit' => int 1 'out' => array (size=1) 0 => int 9 'out_hit' => array (size=1) 0 => int 1 9 => array (size=7) 'op_start' => int 9 'op_end' => int 11 'line_start' => int 5 'line_end' => int 5 'hit' => int 1 'out' => array (size=2) 0 => int 12 1 => int 5 'out_hit' => array (size=2) 0 => int 1 1 => int 1 12 => array (size=7) 'op_start' => int 12 'op_end' => int 13 'line_start' => int 8 'line_end' => int 8 'hit' => int 1 'out' => array (size=1) 0 => int 2147483645 'out_hit' => array (size=1) 0 => int 0 'paths' => array (size=2) 0 => array (size=2) 'path' => array (size=3) 0 => int 0 1 => int 9 2 => int 12 'hit' => int 0 1 => array (size=2) 'path' => array (size=5) 0 => int 0 1 => int 9 2 => int 5 3 => int 9 4 => int 12 'hit' => int 1
Inside each function the branches
element describes each branch.
9 => array (size=7) 'op_start' => int 9 'op_end' => int 11 'line_start' => int 5 'line_end' => int 5 'hit' => int 1 'out' => array (size=2) 0 => int 12 1 => int 5 'out_hit' => array (size=2) 0 => int 1 1 => int 1
The index is the starting opcode, and the fields mean:
op_start
opcode.op_end
opcode. This can potentially be
a number that is lower than line_start
due to the way the PHP
compiler generates opcodes.op_start
opcodes for branches that
can follow this one.out
and indicates
whether this branch exit has been reached.
Each function also contains a paths
element, which shows all the
possible paths through the function, and whether they have been hit.
1 => array (size=2) 'path' => array (size=5) 0 => int 0 1 => int 9 2 => int 5 3 => int 9 4 => int 12 'hit' => int 1
The index is a normal PHP array index, and the fields mean:
op_start
opcodes indicating the
branches that make up this path. In the example, 9
features twice
because this path (the loop) has after branch 9
an exit to opcode
5
(the start of the loop), and opcode 12
(the next
branch after the loop).
The Xdebug source contains a
file
containing a dump_branch_coverage
function, which you can use the
show the information in a more concise way. The above array would instead be
shown as:
c - branches - 00; OP: 00-04; line: 06-07 HIT; out1: 09 HIT - 05; OP: 05-08; line: 08-07 HIT; out1: 09 HIT - 09; OP: 09-11; line: 07-07 HIT; out1: 12 HIT; out2: 05 HIT - 12; OP: 12-13; line: 10-10 HIT; out1: EX X - paths - 0 9 12: X - 0 9 5 9 12: HIT
The function also generates a file /tmp/paths.dot
, which can be
processed with the dot tool of the
Graphviz software to create an image.
dot -Tpng /tmp/paths.dot > /tmp/paths.png
This generates an image where a solid line means that the path has been followed, and a dashed line means that that path has not been followed.
Show and retrieve diagnostic information
This function presents APIs to retrieve information about Xdebug itself. Which information gets returned, or displayed, depends on which arguments, or none at all, are given.
$category
= Without arguments, this function returns an HTML page which shows diagnostic information. It is analogous to PHP's phpinfo() function.
The HTML output includes which mode is active, what the settings are, and diagnostic information in case there are problems with debugging connections, opening of files, etc.
Each warning and error in the diagnostics log also links through to the Description of errors documentation page.
$category
= 'mode'
(New in Xdebug 3.1)
The function returns an array of all the
enabled modes, whether through xdebug.mode or the
XDEBUG_MODE
environment variable.
<?php
var_dump( xdebug_info( 'mode' ) );
?>
array(3) { [0] => string(5) "debug" [1] => string(7) "develop" [2] => string(5) "trace" }
$category
= 'extension-flags'
(New in Xdebug 3.1)
The function returns an array of all the compile flags that were enabled when
running ./configure
as part of Xdebug's compilation process.
The only flag that is available, is the compression
flag. If this
flag is enabled, then the xdebug.use_compression setting is available, and enabled by default.
Profiling and Function Trace will create GZip compressed files if the xdebug.use_compression setting is turned on (the default).
<?php
var_dump( xdebug_info( 'extension-flags' ) );
?>
array(1) { [0] => string(11) "compression" }
Set filter
This function configures a filter that Xdebug employs when displaying stack traces or recording function traces, or when gathering code coverage. Filter configurations are applied to each execution unit (function, method, script body) independently.
The first argument, $group
selects for which feature you want to
set up a filter. Currently there are two groups:
There are different kinds of filters that you can set. You can filter on either file path prefix, or fully qualified class name prefix (i.e. namespace). For each filter type you can a list of paths/namespaces to include or exclude. All matches are done in a case-insensitive way.
The XDEBUG_FILTER_CODE_COVERAGE
group only supports
XDEBUG_PATH_INCLUDE
, XDEBUG_PATH_EXCLUDE
, and
XDEBUG_FILTER_NONE
. All matches are done in a case-insensitive
way.
The constants to use as second "$list_type
" argument are:
Configures a list of file paths to include. An execution unit is
included in the output if its file path is prefixed by any of the prefixes in
the array passed as third $configuration
argument.
Please
note that a prefix of /home/derick
would also match files in
/home/derickrethans
, so it is recommended that you add the
trailing slash to the prefix in order to prevent this.
Sets up a list of paths to exclude. An execution unit will be excluded
from the output if its file path is prefixed by any of the prefixes from the
$configuration
array.
Configures a list of class name prefixes to include. An execution unit is included in
the output if the class name, after namespace expansion, matches one of the
prefixes in the $configuration
array. An empty string value is
special, and means functions that do not belong to a class. These are either
user-defined, or built-in PHP functions (e.g. strlen()
).
Name space expansion happens automatically in PHP, and its engine will
always see the full qualified class name. In the code below, the
fully qualified class name DramIO\Whisky
:
<?php
namespace DramIO;
class Whisky {
}
In order to match for all clases within a namespace, it is recommended to specify the prefix with the namespace separator
$configuration
array.$group
.
It is not possible to configure a filter for paths/namespaces at the same time,
and neither is it possible to configure which paths to exclude and include at
the same time. Only one of the four list types can be active at any one time.
It is possible however, to turn off the filter altogether by using
XDEBUG_FILTER_NONE
.
To exclude all files in the vendor
sub-directory in traces:
<?php
xdebug_set_filter( XDEBUG_FILTER_TRACING, XDEBUG_PATH_EXCLUDE, [ __DIR__ . "/vendor/" ] );
?>
To include only function calls (without class name), and methods calls for the
ezc
and DramIO\
classes in traces:
<?php
xdebug_set_filter( XDEBUG_FILTER_TRACING, XDEBUG_NAMESPACE_INCLUDE, [ "", "ezc", "DramIO\\" ] );
?>
To only perform code-coverage analysis for files in the src
sub-directory:
<?php
xdebug_set_filter( XDEBUG_FILTER_CODE_COVERAGE, XDEBUG_PATH_INCLUDE, [ __DIR__ . "/src/" ] );
?>
Starts code coverage
This function starts gathering the information for code coverage. The information can be retrieved with the xdebug_get_code_coverage() function.
This function has three options, which act as a bitfield:
You can use the options as shown in the following example.
<?php
xdebug_start_code_coverage( XDEBUG_CC_UNUSED | XDEBUG_CC_DEAD_CODE );
?>
Stops code coverage
This function stops collecting information, the information in memory will be destroyed. If you pass 0 as an argument, then the code coverage information will not be destroyed so that you can resume the gathering of information with the xdebug_start_code_coverage() function again.