Welcome, Guest. Please login or register.

Author Topic: NedIO8 mysql out of memory  (Read 2697 times)

otbl

  • Newbie
  • *
  • Posts: 4
    • View Profile
NedIO8 mysql out of memory
« on: August 26, 2013, 06:38:43 AM »
Hi,

After 24 hours I get an "Out of memory" error message in mysql logs. At the same time openbsd reprots a lot of free memory. Where should I change the memory limit


130822  2:34:00 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1006632 bytes)
130822  2:34:00 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1046544 bytes)
130822  2:34:00 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1046596 bytes)
130822  2:35:05 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 671088 bytes)
130822  2:36:32 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1006632 bytes)
130822  2:37:27 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1006632 bytes)
130822  2:37:42 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1006632 bytes)
130822  2:38:37 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1006632 bytes)
130822  2:40:07 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1046544 bytes)
130822  2:40:07 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1046596 bytes)
130822  2:47:15 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1006632 bytes)
130822  2:47:15 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1046544 bytes)
130822  2:47:15 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1046596 bytes)
130822  2:48:15 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1006632 bytes)
130822  2:48:15 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1046544 bytes)
130822  2:48:15 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1046596 bytes)
130822  2:48:23 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1046544 bytes)
130822  2:48:23 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1046596 bytes)
130822  2:49:23 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1046544 bytes)
130822  2:49:23 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1046596 bytes)
130822  2:49:31 [ERROR] /usr/local/libexec/mysqld: Out of memory (Needed 1046544 bytes)



login .conf :
default:\
        :path=/usr/bin /bin /usr/sbin /sbin /usr/X11R6/bin /usr/local/bin /usr/local/sbin:\
        :umask=022:\
        :datasize-max=infinity:\
        :datasize-cur=512M:\
        :maxproc-max=1024:\
        :maxproc-cur=1024:\
        :openfiles-cur=512:\
        :stacksize-cur=8M:\
        :localcipher=blowfish,6:\
        :ypcipher=old:\
        :tc=auth-defaults:\
        :tc=auth-ftp-defaults:

#
# Settings used by /etc/rc and root
# This must be set properly for daemons started as root by inetd as well.
# Be sure reset these values back to system defaults in the default class!
#



my.cnf

# Here follows entries for some specific programs

# The MySQL server
[mysqld]
port            = 3306
socket          = /var/run/mysql/mysql.sock
skip-locking
key_buffer_size = 32M
max_allowed_packet = 4M
table_open_cache = 64
sort_buffer_size = 4096K
net_buffer_length = 64K
read_buffer_size = 1024K
read_rnd_buffer_size = 2048K
myisam_sort_buffer_size = 16M

Philippe

rickli

  • Administrator
  • Hero Member
  • *****
  • Posts: 2552
    • View Profile
    • NeDi
Re: NedIO8 mysql out of memory
« Reply #1 on: August 27, 2013, 09:39:57 PM »
I'm actually chasing some out of memory issues on a large network here as well. The nedi.pl process blows up to 400M and then reads the nodes....and dies with out of memory. However there's at least 500M left of free RAM!

I'm trying to figure out which hashes grow that big but it's difficult! I haven't seen the mysql daemon using that much mem, though...
Please consider Other-Invoices on your NeDi installation for an annual contribution, tx!
-Remo

rickli

  • Administrator
  • Hero Member
  • *****
  • Posts: 2552
    • View Profile
    • NeDi
Re: NedIO8 mysql out of memory
« Reply #2 on: September 29, 2013, 01:20:15 PM »
FYI, found and removed some culprits during discovery. E.g. on a network with 500 chassis switches and 50k nodes, I've reduced the memory footprint from 440MB to 100MB!
Please consider Other-Invoices on your NeDi installation for an annual contribution, tx!
-Remo