5:44 p.m.
https://kojipkgs.fedoraproject.org//work/tasks/3814/68223814/build.log
cd
/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/i686-redhat-linux-gnu/layers
&& /usr/bin/g++ -DAPI_NAME=\"Vulkan\" -DVK_ENABLE_BETA_EXTENSIONS
-DVK_USE_PLATFORM_WAYLAND_KHR -DVK_USE_PLATFORM_WAYLAND_KHX
-DVK_USE_PLATFORM_XCB_KHR -DVK_USE_PLATFORM_XCB_KHX
-DVK_USE_PLATFORM_XLIB_KHR -DVK_USE_PLATFORM_XLIB_KHX
-DVK_USE_PLATFORM_XLIB_XRANDR_EXT -DVkLayer_khronos_validation_EXPORTS
-I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/layers
-I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/layers/generated
-I/usr/include/glslang -I/usr/include/spirv/include
-I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/i686-redhat-linux-gnu
-I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/i686-redhat-linux-gnu/layers
-O2 -flto=auto -ffat-lto-objects -fexceptions -g1
-grecord-gcc-switches -pipe -Wall -Werror=format-security
-Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS
-specs=/usr/lib/rpm/redhat/redhat-hardened-cc1
-fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1
-m32 -march=i686 -mtune=generic -msse2 -mfpmath=sse -mstackrealign
-fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection
-Wpointer-arith -Wno-unused-function -Wno-sign-compare -DNDEBUG -fPIC
-Wall -Wextra -Wno-unused-parameter -Wno-missing-field-initializers
-fno-strict-aliasing -fno-builtin-memcmp -fvisibility=hidden
-Wimplicit-fallthrough=0 -std=gnu++11 -MD -MT
layers/CMakeFiles/VkLayer_khronos_validation.dir/generated/chassis.cpp.o
-MF CMakeFiles/VkLayer_khronos_validation.dir/generated/chassis.cpp.o.d
-o CMakeFiles/VkLayer_khronos_validation.dir/generated/chassis.cpp.o
-c
/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/layers/generated/chassis.cpp
cc1plus: out of memory allocating 65536 bytes after a total of 3310292992 bytes
We already use -g1 to try and reduce memory usage, and I tried not
doing parallel jobs in case it was too much? any suggestions, is this
LTO?
Dave.
5:59 p.m.
On 5/18/2021 4:44 PM, David Airlie wrote:
https://kojipkgs.fedoraproject.org//work/tasks/3814/68223814/build.log
cd
/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/i686-redhat-linux-gnu/layers
&& /usr/bin/g++ -DAPI_NAME=\"Vulkan\" -DVK_ENABLE_BETA_EXTENSIONS
-DVK_USE_PLATFORM_WAYLAND_KHR -DVK_USE_PLATFORM_WAYLAND_KHX
-DVK_USE_PLATFORM_XCB_KHR -DVK_USE_PLATFORM_XCB_KHX
-DVK_USE_PLATFORM_XLIB_KHR -DVK_USE_PLATFORM_XLIB_KHX
-DVK_USE_PLATFORM_XLIB_XRANDR_EXT -DVkLayer_khronos_validation_EXPORTS
-I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/layers
-I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/layers/generated
-I/usr/include/glslang -I/usr/include/spirv/include
-I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/i686-redhat-linux-gnu
-I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/i686-redhat-linux-gnu/layers
-O2 -flto=auto -ffat-lto-objects -fexceptions -g1
-grecord-gcc-switches -pipe -Wall -Werror=format-security
-Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS
-specs=/usr/lib/rpm/redhat/redhat-hardened-cc1
-fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1
-m32 -march=i686 -mtune=generic -msse2 -mfpmath=sse -mstackrealign
-fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection
-Wpointer-arith -Wno-unused-function -Wno-sign-compare -DNDEBUG -fPIC
-Wall -Wextra -Wno-unused-parameter -Wno-missing-field-initializers
-fno-strict-aliasing -fno-builtin-memcmp -fvisibility=hidden
-Wimplicit-fallthrough=0 -std=gnu++11 -MD -MT
layers/CMakeFiles/VkLayer_khronos_validation.dir/generated/chassis.cpp.o
-MF CMakeFiles/VkLayer_khronos_validation.dir/generated/chassis.cpp.o.d
-o CMakeFiles/VkLayer_khronos_validation.dir/generated/chassis.cpp.o
-c
/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/layers/generated/chassis.cpp
cc1plus: out of memory allocating 65536 bytes after a total of 3310292992 bytes
We already use -g1 to try and reduce memory usage, and I tried not
doing parallel jobs in case it was too much? any suggestions, is this
LTO?
Not likely LTO since this isn't a link phase AFAICT.
Jeff
1:48 p.m.
On Tue, May 18, 2021 at 04:59:50PM -0600, Jeff Law wrote:
On 5/18/2021 4:44 PM, David Airlie wrote:
> https://kojipkgs.fedoraproject.org//work/tasks/3814/68223814/build.log
>
> cd
/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/i686-redhat-linux-gnu/layers
> && /usr/bin/g++ -DAPI_NAME=\"Vulkan\" -DVK_ENABLE_BETA_EXTENSIONS
> -DVK_USE_PLATFORM_WAYLAND_KHR -DVK_USE_PLATFORM_WAYLAND_KHX
> -DVK_USE_PLATFORM_XCB_KHR -DVK_USE_PLATFORM_XCB_KHX
> -DVK_USE_PLATFORM_XLIB_KHR -DVK_USE_PLATFORM_XLIB_KHX
> -DVK_USE_PLATFORM_XLIB_XRANDR_EXT -DVkLayer_khronos_validation_EXPORTS
> -I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/layers
> -I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/layers/generated
> -I/usr/include/glslang -I/usr/include/spirv/include
> -I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/i686-redhat-linux-gnu
>
-I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/i686-redhat-linux-gnu/layers
> -O2 -flto=auto -ffat-lto-objects -fexceptions -g1
> -grecord-gcc-switches -pipe -Wall -Werror=format-security
> -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS
> -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1
> -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1
> -m32 -march=i686 -mtune=generic -msse2 -mfpmath=sse -mstackrealign
> -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection
> -Wpointer-arith -Wno-unused-function -Wno-sign-compare -DNDEBUG -fPIC
> -Wall -Wextra -Wno-unused-parameter -Wno-missing-field-initializers
> -fno-strict-aliasing -fno-builtin-memcmp -fvisibility=hidden
> -Wimplicit-fallthrough=0 -std=gnu++11 -MD -MT
> layers/CMakeFiles/VkLayer_khronos_validation.dir/generated/chassis.cpp.o
> -MF CMakeFiles/VkLayer_khronos_validation.dir/generated/chassis.cpp.o.d
> -o CMakeFiles/VkLayer_khronos_validation.dir/generated/chassis.cpp.o
> -c
/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/layers/generated/chassis.cpp
> cc1plus: out of memory allocating 65536 bytes after a total of 3310292992 bytes
>
> We already use -g1 to try and reduce memory usage, and I tried not
> doing parallel jobs in case it was too much? any suggestions, is this
> LTO?
Not likely LTO since this isn't a link phase AFAICT.
And parallel jobs reduction isn't likely to help out, it looks like the
single cc1plus process is hitting the 3GB/1GB split anyhow. ;(
Not sure what to suggest here...
kevin
1:57 p.m.
On Thu, May 20, 2021 at 4:51 AM Kevin Fenzi <kevin(a)scrye.com> wrote:
On Tue, May 18, 2021 at 04:59:50PM -0600, Jeff Law wrote:
>
> On 5/18/2021 4:44 PM, David Airlie wrote:
> > https://kojipkgs.fedoraproject.org//work/tasks/3814/68223814/build.log
> >
> > cd
/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/i686-redhat-linux-gnu/layers
> > && /usr/bin/g++ -DAPI_NAME=\"Vulkan\"
-DVK_ENABLE_BETA_EXTENSIONS
> > -DVK_USE_PLATFORM_WAYLAND_KHR -DVK_USE_PLATFORM_WAYLAND_KHX
> > -DVK_USE_PLATFORM_XCB_KHR -DVK_USE_PLATFORM_XCB_KHX
> > -DVK_USE_PLATFORM_XLIB_KHR -DVK_USE_PLATFORM_XLIB_KHX
> > -DVK_USE_PLATFORM_XLIB_XRANDR_EXT -DVkLayer_khronos_validation_EXPORTS
> > -I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/layers
> > -I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/layers/generated
> > -I/usr/include/glslang -I/usr/include/spirv/include
> >
-I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/i686-redhat-linux-gnu
> >
-I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/i686-redhat-linux-gnu/layers
> > -O2 -flto=auto -ffat-lto-objects -fexceptions -g1
> > -grecord-gcc-switches -pipe -Wall -Werror=format-security
> > -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS
> > -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1
> > -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1
> > -m32 -march=i686 -mtune=generic -msse2 -mfpmath=sse -mstackrealign
> > -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection
> > -Wpointer-arith -Wno-unused-function -Wno-sign-compare -DNDEBUG -fPIC
> > -Wall -Wextra -Wno-unused-parameter -Wno-missing-field-initializers
> > -fno-strict-aliasing -fno-builtin-memcmp -fvisibility=hidden
> > -Wimplicit-fallthrough=0 -std=gnu++11 -MD -MT
> > layers/CMakeFiles/VkLayer_khronos_validation.dir/generated/chassis.cpp.o
> > -MF CMakeFiles/VkLayer_khronos_validation.dir/generated/chassis.cpp.o.d
> > -o CMakeFiles/VkLayer_khronos_validation.dir/generated/chassis.cpp.o
> > -c
/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/layers/generated/chassis.cpp
> > cc1plus: out of memory allocating 65536 bytes after a total of 3310292992
bytes
> >
> > We already use -g1 to try and reduce memory usage, and I tried not
> > doing parallel jobs in case it was too much? any suggestions, is this
> > LTO?
>
> Not likely LTO since this isn't a link phase AFAICT.
And parallel jobs reduction isn't likely to help out, it looks like the
single cc1plus process is hitting the 3GB/1GB split anyhow. ;(
Oh wow I forgot that existed, so it's not even a VM configuration issue.
I'll go reproduce somewhere locally and experiment in more detail by
removing my hair.
Dave.
2:03 p.m.
On Thu, May 20, 2021 at 04:57:03AM +1000, David Airlie wrote:
> On Tue, May 18, 2021 at 04:59:50PM -0600, Jeff Law wrote:
> >
> > On 5/18/2021 4:44 PM, David Airlie wrote:
> > > https://kojipkgs.fedoraproject.org//work/tasks/3814/68223814/build.log
> > >
> > > cd
/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/i686-redhat-linux-gnu/layers
> > > && /usr/bin/g++ -DAPI_NAME=\"Vulkan\"
-DVK_ENABLE_BETA_EXTENSIONS
> > > -DVK_USE_PLATFORM_WAYLAND_KHR -DVK_USE_PLATFORM_WAYLAND_KHX
> > > -DVK_USE_PLATFORM_XCB_KHR -DVK_USE_PLATFORM_XCB_KHX
> > > -DVK_USE_PLATFORM_XLIB_KHR -DVK_USE_PLATFORM_XLIB_KHX
> > > -DVK_USE_PLATFORM_XLIB_XRANDR_EXT -DVkLayer_khronos_validation_EXPORTS
> > > -I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/layers
> > >
-I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/layers/generated
> > > -I/usr/include/glslang -I/usr/include/spirv/include
> > >
-I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/i686-redhat-linux-gnu
> > >
-I/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/i686-redhat-linux-gnu/layers
> > > -O2 -flto=auto -ffat-lto-objects -fexceptions -g1
> > > -grecord-gcc-switches -pipe -Wall -Werror=format-security
> > > -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS
> > > -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1
> > > -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1
> > > -m32 -march=i686 -mtune=generic -msse2 -mfpmath=sse -mstackrealign
> > > -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection
> > > -Wpointer-arith -Wno-unused-function -Wno-sign-compare -DNDEBUG -fPIC
> > > -Wall -Wextra -Wno-unused-parameter -Wno-missing-field-initializers
> > > -fno-strict-aliasing -fno-builtin-memcmp -fvisibility=hidden
> > > -Wimplicit-fallthrough=0 -std=gnu++11 -MD -MT
> > > layers/CMakeFiles/VkLayer_khronos_validation.dir/generated/chassis.cpp.o
> > > -MF CMakeFiles/VkLayer_khronos_validation.dir/generated/chassis.cpp.o.d
> > > -o CMakeFiles/VkLayer_khronos_validation.dir/generated/chassis.cpp.o
> > > -c
/builddir/build/BUILD/Vulkan-ValidationLayers-sdk-1.2.176.1/layers/generated/chassis.cpp
> > > cc1plus: out of memory allocating 65536 bytes after a total of 3310292992
bytes
> > >
> > > We already use -g1 to try and reduce memory usage, and I tried not
> > > doing parallel jobs in case it was too much? any suggestions, is this
> > > LTO?
> >
> > Not likely LTO since this isn't a link phase AFAICT.
>
> And parallel jobs reduction isn't likely to help out, it looks like the
> single cc1plus process is hitting the 3GB/1GB split anyhow. ;(
Oh wow I forgot that existed, so it's not even a VM configuration issue.
I'll go reproduce somewhere locally and experiment in more detail by
removing my hair.
As a start, it would be useful to have preprocessed source so that it can be
looked at without the rest of the package.
One interesting thing is try to compile it (the preprocessed testcase with
the same command line options) on x86_64 with -m32 -fmem-report and see
where the memory is spent there (of course, on x86_64 it will take slightly
more memory as pointers are larger).
Removing -flto could save some memory; otherwise, it ddepends on where most
of the memory goes, if into optimizations, perhaps disable some of them or
compile with -O1 etc., either for the whole file or just some of the largest
functions. If the memory is eaten already in the C++ FE, like instantiation
of excessively large (or too many) templates, then splitting the source
might be the only way to make it compile.
Jakub
3:43 a.m.
Is disabling debug on i686 an option?
--- a/vulkan-validation-layers.spec
+++ b/vulkan-validation-layers.spec
@@ -43,7 +43,12 @@ developing applications that use %{name}.
%build
# Decrease debuginfo verbosity to reduce memory consumption even more
+%ifarch %{ix86}
+%global debug_package %{nil}
+%global optflags %(echo %{optflags} | sed 's/-g /-g0 /')
+%else
%global optflags %(echo %{optflags} | sed 's/-g /-g1 /')
+%endif
%global optflags %(echo %{optflags} | sed 's/-O2 /-O1 /')
%cmake3 -DCMAKE_BUILD_TYPE=Release \
10:57 p.m.
On Thu, May 20, 2021 at 6:45 PM Leigh Scott <leigh123linux(a)gmail.com> wrote:
Is disabling debug on i686 an option?
--- a/vulkan-validation-layers.spec
+++ b/vulkan-validation-layers.spec
@@ -43,7 +43,12 @@ developing applications that use %{name}.
%build
# Decrease debuginfo verbosity to reduce memory consumption even more
+%ifarch %{ix86}
+%global debug_package %{nil}
+%global optflags %(echo %{optflags} | sed 's/-g /-g0 /')
+%else
%global optflags %(echo %{optflags} | sed 's/-g /-g1 /')
+%endif
%global optflags %(echo %{optflags} | sed 's/-O2 /-O1 /')
I ended up dropping to O1 as sufficient, I don't think it'll really
matter for this package to not be optimised.
But I could consider dropping to g0 on ix86 I suppose.
But it's mostly a debugging package so I think it might not be optimal
to have no symbols for it at all.
Dave.
1082
days inactive
1086
days old
7 comments
5 participants
participants (5)
-
David Airlie -
Jakub Jelinek -
Jeff Law -
Kevin Fenzi -
Leigh Scott