Zotonic 1.0.0 rc14 crashes with Erlang 25?

I tried to install Zotonic on my System:
Host: x800 Kernel: 5.4.0-135-generic x86_64 bits: 64 Desktop: MATE 1.26.0 Distro: Linux Mint 20.3 Una
Hardware: CPU: Topology: 2x Quad Core model: Intel Xeon E5540 bits: 64 type: MT MCP SMP L2 cache: 16.0 MiB

I am using
Erlang/OTP 25 [erts-13.0.4] [source] [64-bit] [smp:16:16] [ds:16:16:10] [async-threads:1] [jit:ns]

When I try to start bin/zotonic debug I get:

markus@x800:~/entw/zotonic$ bin/zotonic debug
Erlang/OTP 25 [erts-13.0.4] [source] [64-bit] [smp:16:16] [ds:16:16:10] [async-threads:1] [jit:ns]

Eshell V13.0.4  (abort with ^G)
(zotonic@x800)1> {"init terminating in do_boot",{{badmatch,{error,{'zotonic@x800',{already_exists,'zotonic@x800'}}}},[{zotonic_core,ensure_mnesia_schema,0,[{file,"/home/markus/entw/zotonic/apps/zotonic_core/src/zotonic_core.erl"},{line,1}
init terminating in do_boot ({{badmatch,{error,{zotonic@x800,{_}}}},[{zotonic_core,ensure_mnesia_schema,0,[{_},{_}]},{zotonic_launcher_app,load_configs,1,[{_},{_}]},{zotonic_launcher_app,start,0,[{_},{_}]},{zotonic,start,0,[{_},{_}]},{in)

Crash dump is being written to: erl_crash.dump...done

Any idea?
I tried
make clean
make all

I didn’t try any other Zotonic version before.
I have not tested the docker image yet.
Postgres seems to be ok. This crash is quite early, so any missing access rights?

Any help welcome
Markus

1 Like

The {already_exists,'zotonic@x800'} means that there is another beam running with that name, can you check your processes for loose beam.smp processes?

1 Like

Hello Marc,

thanks for the reply.
I fear there is another problem.

markus@x800:~$ pgrep zotonic
markus@x800:~$ pgrep beam.smp
markus@x800:~$ pgrep zotonic@x800

show no results.
Also ps aux shows no beam running not even as a Zombie.
After rebooting the machine with no other program running I get the same result as described in my last e-mail.
I started by intention an Erlang shell in another terminal and tried again to start zotonic → same result.

Its curious that Erlang is crashing

=erl_crash_dump:0.5
Wed Dec 28 10:19:58 2022
Slogan: init terminating in do_boot ({{badmatch,{error,{zotonic@x800,{_}}}},[{zotonic_core,ensure_mnesia_schema,0,[{_},{_}]},{zotonic_launcher_app,load_configs,1,[{_},{_}]},{zotonic_launcher_app,start,0,[{_},{_}]},{zotonic,start,0,[{_},{_}]},{init,start_em,1,[]},{init,do_boot,3,[]}]})
System version: Erlang/OTP 25 [erts-13.0.4] [source] [64-bit] [smp:16:16] [ds:16:16:10] [async-threads:1] [jit:ns]
Taints: 
Atoms: 11819
Calling Thread: scheduler:4
=scheduler:1
Scheduler S

and then in scheduler message 4:

=scheduler:4
Scheduler Sleep Info Flags: 
Scheduler Sleep Info Aux Work: DELAYED_AW_WAKEUP | THR_PRGR_LATER_OP
Current Port: 
Run Queue Max Length: 0
Run Queue High Length: 0
Run Queue Normal Length: 1
Run Queue Low Length: 0
Run Queue Port Length: 0
Run Queue Flags: NONEMPTY_NORMAL | OUT_OF_WORK | HALFTIME_OUT_OF_WORK | NONEMPTY | EXEC
Current Process: <0.0.0>
Current Process State: Running
Current Process Internal State: ACT_PRIO_NORMAL | USR_PRIO_NORMAL | PRQ_PRIO_NORMAL | ACTIVE | RUNNING | ACTIVE_SYS
Current Process Program counter: 0x00007ff9cbba0524 (init:boot_loop/2 + 100)
Current Process Limited Stack Trace:
0x00007ff9c925bc60:SReturn addr 0xCBC0A224 (erlang:halt/1 + 140)
0x00007ff9c925bc78:SReturn addr 0xCBB98C30 (<terminate process normally>)

Any other idea?

Markus

1 Like

Some more info:

Now I found the error.log file…
I have to say quite hidden in
~/.cache/zotonic/log
It seems that Zotero was starting ione time yesterday and writing the console.log and error.log.
All newer tries to start Zotero generated no log files anymore.

Here the content of console.log:

2022-12-27 17:12:57 INFO <0.82.0> [z_config_files:logs_dir_1/0:176] ▸ text="Create log directory" path=/home/markus/.cache/zotonic/log in=zotonic_core 
2022-12-27 17:12:57 INFO <0.9.0> [z_config_files:data_dir_1/0:244] ▸ text="Created data directory" path=/home/markus/.local/share/zotonic in=zotonic_core 
2022-12-27 17:12:57 NOTICE <0.9.0> [zotonic_launcher_app:start/0:46] ▸ text="Zotonic starting" init_files="[\"/home/markus/.config/zotonic/config/1/erlang.config\"]" in=zotonic_launcher config_files="[\"/home/markus/.config/zotonic/config/1/zotonic.config\"]" 
2022-12-27 17:12:58 ERROR <0.159.0> [supervisor:start_children/2:392] ▸ report="[{supervisor,{local,mimetypes_sup}},{errorContext,start_error},{reason,{{badmatch,{error,eacces}},[{mimetypes,write_dispatch,1,[{file,\"/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl\"},{line,390}]},{mimetypes,init,1,[{file,\"/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl\"},{line,244}]},{gen_server,init_it,2,[{file,\"gen_server.erl\"},{line,848}]},{gen_server,init_it,6,[{file,\"gen_server.erl\"},{line,811}]},{proc_lib,init_p_do_apply,3,[{file,\"proc_lib.erl\"},{line,240}]}]}},{offender,[{pid,undefined},{id,mimetypes},{mfargs,{mimetypes,start_link,[]}},{restart_type,permanent},{significant,false},{shutdown,5000},{child_type,worker}]}]" label={supervisor,start_error} 
2022-12-27 17:12:58 ERROR <0.160.0> [proc_lib:crash_report/4:539] ▸ report=[[{initial_call,{mimetypes,init,['Argument__1']}},{pid,<0.160.0>},{registered_name,[]},{ancestors,[mimetypes_sup,<0.158.0>]},{message_queue_len,0},{messages,[]},{links,[<0.159.0>]},{dictionary,[]},{trap_exit,false},{status,running},{heap_size,196650},{stack_size,28},{reductions,177843}],[]] label={proc_lib,crash} 
  Reason: badmatch: {error,eacces}
     mimetypes:write_dispatch/1 @ "/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl":390
     mimetypes:init/1 @ "/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl":244
     gen_server:init_it/2 @ "gen_server.erl":848
     gen_server:init_it/6 @ "gen_server.erl":811
     proc_lib:init_p_do_apply/3 @ "proc_lib.erl":240
2022-12-27 17:12:58 ERROR <0.157.0> [proc_lib:crash_report/4:539] ▸ report=[[{initial_call,{application_master,init,['Argument__1','Argument__2','Argument__3','Argument__4']}},{pid,<0.157.0>},{registered_name,[]},{ancestors,[<0.156.0>]},{message_queue_len,1},{messages,[{'EXIT',<0.158.0>,normal}]},{links,[<0.156.0>,<0.44.0>]},{dictionary,[]},{trap_exit,true},{status,running},{heap_size,376},{stack_size,28},{reductions,188}],[]] label={proc_lib,crash} 
  Reason: {shutdown,
    {failed_to_start_child,mimetypes,
        {{badmatch,{error,eacces}},
         [{mimetypes,write_dispatch,1,
              [{file,
                   "/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl"},
               {line,390}]},
          {mimetypes,init,1,
              [{file,
                   "/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl"},
               {line,244}]},
          {gen_server,init_it,2,[{file,"gen_server.erl"},{line,848}]},
          {gen_server,init_it,6,[{file,"gen_server.erl"},{line,811}]},
          {proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,240}]}]}}}: {mimetypes_app,start,[normal,[]]}
     application_master:init/4 @ "application_master.erl":142
     proc_lib:init_p_do_apply/3 @ "proc_lib.erl":240
2022-12-27 17:12:58 NOTICE <0.44.0> [application_controller:info_exited/3:2119] ▸ report="[{application,mimetypes},{exited,{{shutdown,{failed_to_start_child,mimetypes,{{badmatch,{error,eacces}},[{mimetypes,write_dispatch,1,[{file,\"/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl\"},{line,390}]},{mimetypes,init,1,[{file,\"/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl\"},{line,244}]},{gen_server,init_it,2,[{file,\"gen_server.erl\"},{line,848}]},{gen_server,init_it,6,[{file,\"gen_server.erl\"},{line,811}]},{proc_lib,init_p_do_apply,3,[{file,\"proc_lib.erl\"},{line,240}]}]}}},{mimetypes_app,start,[normal,[]]}}},{type,temporary}]" label={application_controller,exit} 
2022-12-27 17:12:58 EMERGENCY <0.9.0> [zotonic:start/0:48] ▸ text="Zotonic start error" result=error reason="{{shutdown,{failed_to_start_child,mimetypes,{{badmatch,{error,eacces}},[{mimetypes,write_dispatch,1,[{file,\"/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl\"},{line,390}]},{mimetypes,init,1,[{file,\"/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl\"},{line,244}]},{gen_server,init_it,2,[{file,\"gen_server.erl\"},{line,848}]},{gen_server,init_it,6,[{file,\"gen_server.erl\"},{line,811}]},{proc_lib,init_p_do_apply,3,[{file,\"proc_lib.erl\"},{line,240}]}]}}},{mimetypes_app,start,[normal,[]]}}" in=zotonic_launcher

and error.log

2022-12-27 17:12:58 ERROR <0.159.0> [supervisor:start_children/2:392] ▸ report="[{supervisor,{local,mimetypes_sup}},{errorContext,start_error},{reason,{{badmatch,{error,eacces}},[{mimetypes,write_dispatch,1,[{file,\"/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl\"},{line,390}]},{mimetypes,init,1,[{file,\"/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl\"},{line,244}]},{gen_server,init_it,2,[{file,\"gen_server.erl\"},{line,848}]},{gen_server,init_it,6,[{file,\"gen_server.erl\"},{line,811}]},{proc_lib,init_p_do_apply,3,[{file,\"proc_lib.erl\"},{line,240}]}]}},{offender,[{pid,undefined},{id,mimetypes},{mfargs,{mimetypes,start_link,[]}},{restart_type,permanent},{significant,false},{shutdown,5000},{child_type,worker}]}]" label={supervisor,start_error} 
2022-12-27 17:12:58 ERROR <0.160.0> [proc_lib:crash_report/4:539] ▸ report=[[{initial_call,{mimetypes,init,['Argument__1']}},{pid,<0.160.0>},{registered_name,[]},{ancestors,[mimetypes_sup,<0.158.0>]},{message_queue_len,0},{messages,[]},{links,[<0.159.0>]},{dictionary,[]},{trap_exit,false},{status,running},{heap_size,196650},{stack_size,28},{reductions,177843}],[]] label={proc_lib,crash} 
  Reason: badmatch: {error,eacces}
     mimetypes:write_dispatch/1 @ "/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl":390
     mimetypes:init/1 @ "/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl":244
     gen_server:init_it/2 @ "gen_server.erl":848
     gen_server:init_it/6 @ "gen_server.erl":811
     proc_lib:init_p_do_apply/3 @ "proc_lib.erl":240
2022-12-27 17:12:58 ERROR <0.157.0> [proc_lib:crash_report/4:539] ▸ report=[[{initial_call,{application_master,init,['Argument__1','Argument__2','Argument__3','Argument__4']}},{pid,<0.157.0>},{registered_name,[]},{ancestors,[<0.156.0>]},{message_queue_len,1},{messages,[{'EXIT',<0.158.0>,normal}]},{links,[<0.156.0>,<0.44.0>]},{dictionary,[]},{trap_exit,true},{status,running},{heap_size,376},{stack_size,28},{reductions,188}],[]] label={proc_lib,crash} 
  Reason: {shutdown,
    {failed_to_start_child,mimetypes,
        {{badmatch,{error,eacces}},
         [{mimetypes,write_dispatch,1,
              [{file,
                   "/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl"},
               {line,390}]},
          {mimetypes,init,1,
              [{file,
                   "/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl"},
               {line,244}]},
          {gen_server,init_it,2,[{file,"gen_server.erl"},{line,848}]},
          {gen_server,init_it,6,[{file,"gen_server.erl"},{line,811}]},
          {proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,240}]}]}}}: {mimetypes_app,start,[normal,[]]}
     application_master:init/4 @ "application_master.erl":142
     proc_lib:init_p_do_apply/3 @ "proc_lib.erl":240
2022-12-27 17:12:58 EMERGENCY <0.9.0> [zotonic:start/0:48] ▸ text="Zotonic start error" result=error reason="{{shutdown,{failed_to_start_child,mimetypes,{{badmatch,{error,eacces}},[{mimetypes,write_dispatch,1,[{file,\"/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl\"},{line,390}]},{mimetypes,init,1,[{file,\"/home/markus/entw/zotonic/_build/default/lib/mimetypes/src/mimetypes.erl\"},{line,244}]},{gen_server,init_it,2,[{file,\"gen_server.erl\"},{line,848}]},{gen_server,init_it,6,[{file,\"gen_server.erl\"},{line,811}]},{proc_lib,init_p_do_apply,3,[{file,\"proc_lib.erl\"},{line,240}]}]}}},{mimetypes_app,start,[normal,[]]}}" in=zotonic_launcher

I will try to analyze the mimetypes.erl source, maybe I will find another hint.

1 Like

I installed everything again - same problem.
During make all I get a punch of warnings. One maybe severe:

===> Compiling gun
_build/default/lib/gun/src/gun.erl:654:29: Warning: erlang:get_stacktrace/0 is removed; use the new try/catch syntax for retrieving the stack backtrace
1 Like

Hi, that warning is ok. Just some old gun code, that might need to be updated.

That mimetypes might well be a problem, it seems it wants to write a “.beam” file in its ebin directory:

%% @private Write a module binary to a file.
-spec write_binary(atom(), binary()) -> ok.
write_binary(Name, Binary) ->
    Dirname = filename:dirname(code:which(?MODULE)),
    Basename = atom_to_list(Name) ++ ".beam",
    Filename = filename:join([Dirname, Basename]),
    file:write_file(Filename, Binary).

Could that directory be read-only in your setup?

1 Like

We are using the OS default directories for configuration and logging.
You can see where they are with ./bin/zotonic config:

bin/zotonic config

# Zotonic config for zotonic@PoToi:
# =================================

zotonic:
    environment: development
    zotonic_apps: /Users/marc/Sites/zotonic-master/apps_user
    security_dir: /Users/marc/.zotonic/security
    data_dir: /Users/marc/Library/Application Support/zotonic
    log_dir: /Users/marc/Library/Logs/zotonic
    cache_dir: /Users/marc/Library/Caches/zotonic
1 Like

I have changed the access rights, but same problem.
I tested also mimetypes standalone in erl with the examples from github.
Thast works also fine.

1 Like

I played also around with the access rights for the several config files and directories listed with
zotonic config which works, but even this doesn’t help.

I erased the old error.log and status.log then I got a message about creating new log files and then the system crashes.

Erlang/OTP 25 [erts-13.0.4] [source] [64-bit] [smp:16:16] [ds:16:16:10] [async-threads:1] [jit:ns]

2022-12-29 11:53:41 INFO <0.82.0> [z_config_files:logs_dir_1/0:176] ▸ text="Create log directory" path=/home/markus/.cache/zotonic/log in=zotonic_core 
=INFO REPORT==== 29-Dec-2022::11:53:40.658936 ===
    in: zotonic_core
    path: /home/markus/.cache/zotonic/log
    text: <<"Create log directory">>
2022-12-29 11:53:41 INFO <0.82.0> [z_config_files:logs_dir_1/0:176] ▸ text="Create log directory" path=/home/markus/.cache/zotonic/log in=zotonic_core 
Eshell V13.0.4  (abort with ^G)
(zotonic@x800)1> {"init terminating in do_boot",{{badmatch,{error,{'zotonic@x800',{already_exists,'zotonic@x800'}}}},[{zotonic_core,ensure_mnesia_schema,0,[{file,"/home/markus/entw/zotonic/apps/zotonic_core/src/zotonic_core.erl"},{line,111}]},{zotonic_launcher_app,load_configs,1,[{file,"/home/markus/entw/zotonic/apps/zotonic_launcher/src/zotonic_launcher_app.erl"},{line,90}]},{zotonic_launcher_app,start,0,[{file,"/home/markus/entw/zotonic/apps/zotonic_launcher/src/zotonic_launcher_app.erl"},{line,41}]},{zotonic,start,0,[{file,"/home/markus/entw/zotonic/apps/zotonic_launcher/src/zotonic.erl"},{line,45}]},{init,start_em,1,[]},{init,do_boot,3,[]}]}}
init terminating in do_boot ({{badmatch,{error,{zotonic@x800,{_}}}},[{zotonic_core,ensure_mnesia_schema,0,[{_},{_}]},{zotonic_launcher_app,load_configs,1,[{_},{_}]},{zotonic_launcher_app,start,0,[{_},{_}]},{zotonic,start,0,[{_},{_}]},{init,start_em,1,[]},{init,do_boot,3,[]}]})

Crash dump is being written to: erl_crash.dump...done

I also tried to start from a lower textmode runlevel, same crash

Whne I checked the “post mortem dump” I see always this message
... zotonic_core,ensure_mnesia_schema ....
Maybe any problem with Mnesia?

I am using actually :

%% coding: utf-8
[{release,"Erlang/OTP","25","13.0.4",
          [{kernel,"8.4.2","/usr/lib/erlang/lib/kernel-8.4.2"},
           {stdlib,"4.0.1","/usr/lib/erlang/lib/stdlib-4.0.1"},
           {sasl,"4.2","/usr/lib/erlang/lib/sasl-4.2"}],
          permanent}].

I will try to install 25.2

Now installed:
Same problem with 25.2 …

Now rebar3 clean

markus@x800:~/.cache/zotonic/log$ rebar3 clean
===> Failed to restore /home/markus/.cache/rebar3/plugins/.rebar3/rebar_compiler_erl/source_apps.dag file. Discarding it.

===> Analyzing applications…
===> Compiling rebar3_ex_doc
=WARNING REPORT==== 29-Dec-2022::13:31:08.751225 ===
Description: “Server authenticity is not verified since certificate path validation is not enabled”
Reason: “The option {verify, verify_peer} and one of the options ‘cacertfile’ or ‘cacerts’ are required to enable this.”

===> Verifying dependencies…

maybe another hint?

1 Like

Marc,

Problem solved I think:

There is a directory:
~/.local/share/zotonic/zotonic@x800/mnesia$
with the binary file:
/home/markus/.local/share/zotonic/zotonic@x800/mnesia/FALLBACK.BUP

x800 is the name of my PC.

I guess anywhere mnesia:install_fallback() is called, creating, according to the docs, FALLBACK.PUB.
Maybe an already existing or corrupt file or even already existing directory
zotonic@machinename in the ..../share/zotonic directory
will crash the mnesia module and also crashes Erlang.

I deleted this directory and Zotonic starts clean.
See message below. Now the latest Erlang 25.2 is installed.
Maybe its worth to do some further file / directory handling or at least a warning when this problem appears.

Thanks for you support.

Markus

                                                                                                                           
markus@x800:~/entw/zotonic$ ./start.sh
Erlang/OTP 25 [erts-13.1.3] [source] [64-bit] [smp:16:16] [ds:16:16:10] [async-threads:1] [jit:ns]

Eshell V13.1.3  (abort with ^G)
(zotonic@x800)1> 2022-12-29 16:35:20 INFO <0.9.0> [z_config_files:data_dir_1/0:244] ▸ text="Created data directory" path=/home/markus/.local/share/zotonic in=zotonic_core 
2022-12-29 16:35:20 NOTICE <0.9.0> [zotonic_launcher_app:start/0:46] ▸ text="Zotonic starting" init_files="[\"/home/markus/.config/zotonic/config/1/erlang.config\"]" in=zotonic_launcher config_files="[\"/home/markus/.config/zotonic/config/1/zotonic.config\"]" 
2022-12-29 16:35:23 NOTICE <0.102.0> [:] ▸ report=[{alarm_handler,{set,{system_memory_high_watermark,[]}}}] label={error_logger,info_report} 
2022-12-29 16:35:23 NOTICE <0.240.0> [:] ▸ text="Setup running ..." 
2022-12-29 16:35:23 NOTICE <0.240.0> [:] ▸ text="Directories verified. Res = ok" 
2022-12-29 16:35:23 NOTICE <0.240.0> [:] ▸ text="Setup finished processing hooks (Mode=normal)..." 
2022-12-29 16:35:23 NOTICE <0.257.0> [:] ▸ report="[{msg,\"Starting reporters with []\\n\"},{options,[]}]" label={error_logger,info_report} 
2022-12-29 16:35:23 NOTICE <0.299.0> [:] ▸ text="filezcache: repopulating cache with 0 keys" 
2022-12-29 16:35:23 NOTICE <0.299.0> [:] ▸ text="filezcache: scanning cache directory for unknown files." 
2022-12-29 16:35:23 NOTICE <0.319.0> [:] ▸ text="Creating qdate ETS Table: qdate_srv" 
Starting keyserver supervisor2022-12-29 16:35:24 NOTICE <0.425.0> [zotonic_listen_smtp:child_spec/0:78] ▸ text="SMTP server listening" protocol=smtp port=2525 ip=127.0.0.1 in=zotonic_listen_smtp 
2022-12-29 16:35:24 INFO <0.425.0> [z_config_files:security_dir_1/0:108] ▸ text="Created security directory" path=/home/markus/.config/zotonic/security in=zotonic_core 
2022-12-29 16:35:24 INFO <0.429.0> [zotonic_filewatcher_inotify:start_inotify/1:173] ▸ text="[inotify] Starting inotify file monitor." 
2022-12-29 16:35:24 NOTICE <0.472.0> [zotonic_listen_mqtt:start_mqtt_listeners_ip4/2:142] ▸ text="MQTT server listening on IPv4" protocol=mqtt port=1883 ip=any in=zotonic_listen_mqtt 
2022-12-29 16:35:24 NOTICE <0.471.0> [zotonic_listen_http:start_http_listeners_ip4/2:148] ▸ text="HTTP IPv4 server listening" protocol=http port=8000 ip=any in=zotonic_listen_http 
2022-12-29 16:35:24 NOTICE <0.472.0> [zotonic_listen_mqtt:start_mqtts_listeners_ip4/2:185] ▸ text="MQTT ssl server listening on IPv4" protocol=mqtt port=8883 ip=any in=zotonic_listen_mqtt 
2022-12-29 16:35:24 INFO <0.472.0> [z_ssl_certs:generate_self_signed/2:213] ▸ text="Generating self-signed ssl keys" in=zotonic_core file=/home/markus/.config/zotonic/security/self-signed/x800-self-signed4096.pem 
2022-12-29 16:35:24 INFO <0.471.0> [z_ssl_certs:generate_self_signed/2:213] ▸ text="Generating self-signed ssl keys" in=zotonic_core file=/home/markus/.config/zotonic/security/self-signed/x800-self-signed4096.pem 
2022-12-29 16:35:25 NOTICE <0.471.0> [:] ▸ text="SSL: Generated SSL self-signed certificate in '/home/markus/.config/zotonic/security/self-signed/x800-self-signed4096.key'" 
2022-12-29 16:35:25 NOTICE <0.471.0> [zotonic_listen_http:start_https_listeners_ip4/2:215] ▸ text="HTTPS IPv4 server listening" protocol=https port=8443 ip=any in=zotonic_listen_http 
2022-12-29 16:35:25 NOTICE <0.471.0> [zotonic_listen_http:start_http_listeners_ip6/2:280] ▸ text="HTTP IPv6 server listening" protocol=http port=8000 ip=any in=zotonic_listen_http 
2022-12-29 16:35:25 NOTICE <0.471.0> [zotonic_listen_http:start_https_listeners_ip6/2:346] ▸ text="HTTPS IPv6 server listening" protocol=https port=8443 ip=any in=zotonic_listen_http 
2022-12-29 16:35:25 NOTICE  site=zotonic_site_status <0.469.0> [z_sites_manager:do_start_site/1:730] ▸ text="Site starting" in=zotonic_core action=starting 
2022-12-29 16:35:26 INFO  site=zotonic_site_status  user_id=1 <0.1055.0> [z_module_manager:manage_schema_if_db/5:1509] ▸ text="Skipping schema for module as the site has no database ('nodb')" result=skip reason=nodb module=mod_base in=zotonic_core 
2022-12-29 16:35:26 INFO  site=zotonic_site_status <0.1036.0> [z_site_startup:do_startup/1:72] ▸ text="Site started, modules loaded" 
2022-12-29 16:35:28 NOTICE <0.472.0> [:] ▸ text="SSL: Generated SSL self-signed certificate in '/home/markus/.config/zotonic/security/self-signed/x800-self-signed4096.key'" 
2022-12-29 16:35:28 NOTICE <0.472.0> [zotonic_listen_mqtt:start_mqtt_listeners_ip6/2:221] ▸ text="MQTT server listening on IPv6" protocol=mqtt port=1883 ip=any in=zotonic_listen_mqtt 
2022-12-29 16:35:28 NOTICE <0.472.0> [zotonic_listen_mqtt:start_mqtts_listeners_ip6/2:253] ▸ text="MQTT ssl server listening on IPv6" protocol=mqtt port=8883 ip=any in=zotonic_listen_mqtt