log_fdw
log_fdw
log_fdw : foreign-data wrapper for Postgres log file access
Overview
| ID | Extension | Package | Version | Category | License | Language |
|---|---|---|---|---|---|---|
| 8810 | log_fdw
|
log_fdw
|
1.4 |
FDW
|
Apache-2.0
|
C
|
| Attribute | Has Binary | Has Library | Need Load | Has DDL | Relocatable | Trusted |
|---|---|---|---|---|---|---|
--s-d--
|
No
|
Yes
|
No
|
Yes
|
no
|
no
|
| Relationships | |
|---|---|
| See Also | pg_sqlog
pgaudit
file_fdw
auto_explain
pgauditlogtofile
logerrors
wrappers
multicorn
|
PG18 fixed by vonng
Packages
| Type | Repo | Version | PG Major Compatibility | Package Pattern | Dependencies |
|---|---|---|---|---|---|
| EXT | PIGSTY
|
1.4 |
18
17
16
15
14
|
log_fdw |
- |
| RPM | PIGSTY
|
1.4 |
18
17
16
15
14
|
log_fdw_$v |
- |
| DEB | PIGSTY
|
1.4 |
18
17
16
15
14
|
postgresql-$v-log-fdw |
- |
| Linux / PG | PG18 | PG17 | PG16 | PG15 | PG14 |
|---|---|---|---|---|---|
el8.x86_64
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
el8.aarch64
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
el9.x86_64
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
el9.aarch64
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
el10.x86_64
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
el10.aarch64
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
d12.x86_64
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
d12.aarch64
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
d13.x86_64
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
d13.aarch64
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
u22.x86_64
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
u22.aarch64
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
u24.x86_64
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
u24.aarch64
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
PIGSTY 1.4
|
Source
pig build pkg log_fdw; # build debInstall
Make sure PGDG and PIGSTY repo available:
pig repo add pgsql -u # add both repo and update cacheInstall this extension with pig:
pig install log_fdw; # install via package name, for the active PG version
pig install log_fdw -v 18; # install for PG 18
pig install log_fdw -v 17; # install for PG 17
pig install log_fdw -v 16; # install for PG 16
pig install log_fdw -v 15; # install for PG 15
pig install log_fdw -v 14; # install for PG 14Create this extension with:
CREATE EXTENSION log_fdw;Usage
Create Server
CREATE EXTENSION log_fdw;
CREATE SERVER log_fdw_server FOREIGN DATA WRAPPER log_fdw;List Available Log Files
SELECT * FROM list_postgres_log_files();Returns the file name and size of each log file in the PostgreSQL log directory.
Create Foreign Table for CSV Logs
SELECT * FROM create_foreign_table_for_log_file(
'postgresql_2024_01_15_csv', -- foreign table name
'log_fdw_server', -- server name
'postgresql-2024-01-15.csv' -- log file name
);Create Foreign Table for Plain Text Logs
SELECT * FROM create_foreign_table_for_log_file(
'postgresql_2024_01_15_log',
'log_fdw_server',
'postgresql-2024-01-15.log'
);Query Log Data
-- Query CSV-format logs (structured columns)
SELECT log_time, error_severity, message
FROM postgresql_2024_01_15_csv
WHERE error_severity = 'ERROR'
ORDER BY log_time DESC
LIMIT 20;
-- Query plain text logs
SELECT * FROM postgresql_2024_01_15_log LIMIT 10;Granting Access to Non-Superusers
Only superusers can create the extension, but access can be granted:
GRANT pg_monitor TO monitoring_user;
GRANT CREATE ON SCHEMA public TO monitoring_user;
GRANT USAGE ON FOREIGN SERVER log_fdw_server TO monitoring_user;Functions Reference
| Function | Description |
|---|---|
list_postgres_log_files() |
List available log files and their sizes |
create_foreign_table_for_log_file(table_name, server_name, file_name) |
Create a foreign table from a log file |
Last updated on