Discussion:
BSD ZFS vs. illumos ZFS
Jim Klimov
2013-10-09 16:09:29 UTC
Permalink
Hello all,

A colleague of mine is more comfortable with FreeBSD than
Solaris families of systems, and asked whether FreeNAS in
particular has any substantial advantages or disadvandages
compared to popular illumos distros (OI, OmniOS) as an OS
for the storage purposes, at home or in business production?

Since there are many BSD folks here, I thought they could
comment about possible advantages of either side, like support
for some ZFS features (I guess cross-pollination is intensive
now and ZFS quality and performance should be very similar
as well as adoption of newly integrated features and bugfixes),
and OS/distro features (service management, driver support,
fault-management (FMA), observability (dtrace, mdb -k), etc.)

Is the choice now more about one's taste and habbits, or are
there some important differences to be aware of (especially
problems, if any)?

Thanks,
//Jim
Saso Kiselkov
2013-10-09 16:20:58 UTC
Permalink
Post by Jim Klimov
OS/distro features (service management,
AFAIK FreeBSD doesn't have anything like SMF.
Post by Jim Klimov
driver support,
Should be very good on FreeBSD.
Post by Jim Klimov
fault-management (FMA),
No such thing on FreeBSD.
Post by Jim Klimov
dtrace
Available on both, though I think not out-of-the-box on FreeBSD (last I
checked you needed to build a custom kernel for that).
Post by Jim Klimov
mdb -k),
FreeBSD uses sysctl to tune the system and kgdb for debugging.
Post by Jim Klimov
Is the choice now more about one's taste and habbits, or are
there some important differences to be aware of (especially
problems, if any)?
"Habits" are not unimportant. Generally people are much better at
problem solving in an environment they're familiar with than in one
that's alien to them, so weigh that as equally important to
having/missing at least one feature.

Cheers,
--
Saso
Radio młodych bandytów
2013-10-09 16:36:02 UTC
Permalink
Post by Jim Klimov
Hello all,
A colleague of mine is more comfortable with FreeBSD than
Solaris families of systems, and asked whether FreeNAS in
particular has any substantial advantages or disadvandages
compared to popular illumos distros (OI, OmniOS) as an OS
for the storage purposes, at home or in business production?
Since there are many BSD folks here, I thought they could
comment about possible advantages of either side, like support
for some ZFS features (I guess cross-pollination is intensive
now and ZFS quality and performance should be very similar
as well as adoption of newly integrated features and bugfixes),
and OS/distro features (service management, driver support,
fault-management (FMA), observability (dtrace, mdb -k), etc.)
Is the choice now more about one's taste and habbits, or are
there some important differences to be aware of (especially
problems, if any)?
Thanks,
//Jim
Openzfs has a nice feature comparison:
http://open-zfs.org/wiki/Features
--
Twoje radio
Pawel Jakub Dawidek
2013-10-09 16:49:43 UTC
Permalink
Post by Radio młodych bandytów
Post by Jim Klimov
Hello all,
A colleague of mine is more comfortable with FreeBSD than
Solaris families of systems, and asked whether FreeNAS in
particular has any substantial advantages or disadvandages
compared to popular illumos distros (OI, OmniOS) as an OS
for the storage purposes, at home or in business production?
Since there are many BSD folks here, I thought they could
comment about possible advantages of either side, like support
for some ZFS features (I guess cross-pollination is intensive
now and ZFS quality and performance should be very similar
as well as adoption of newly integrated features and bugfixes),
and OS/distro features (service management, driver support,
fault-management (FMA), observability (dtrace, mdb -k), etc.)
Is the choice now more about one's taste and habbits, or are
there some important differences to be aware of (especially
problems, if any)?
Thanks,
//Jim
http://open-zfs.org/wiki/Features
It clearly wasn't done by a FreeBSD person:)

The features available only in FreeBSD:
- TRIM support (actually also in ZoL, AFAIK).
- Ability to boot from any ZFS pool (other platforms are limited to one
top-level vdev which can be either disk or a mirror (I hope that's
correct)).
- Quick listing when using options '-o name -s name' - it is at least
100 times faster than alternatives. Very handy when there is huge
number of snapshots.
- ZFS-super-owner - allows regular users to perform file system
operations as root. This is possible when the file system was mounted
by the user, the user is owner of this file system (we force nosuid
option then). Used in FreeBSD netperf cluster, so regular users can
installworld (which set proper ownership of files) to their netbooted
datasets from a build machine.

I'm sure I'm missing some.

PS. Yes, I know I should just put it onto wiki, but if anyone has some
spare cycles I'd be grateful for doing it.
--
Pawel Jakub Dawidek http://www.wheelsystems.com
FreeBSD committer http://www.FreeBSD.org
Sam Zaydel
2013-10-09 16:59:25 UTC
Permalink
The question that I think remains unasked and unanswered is how different
is FreeNAS from latest build of FreeBSD. I don't know the answer to this,
but I think that's what is need to help answer the original question.

S.
Post by Pawel Jakub Dawidek
Post by Radio młodych bandytów
Post by Jim Klimov
Hello all,
A colleague of mine is more comfortable with FreeBSD than
Solaris families of systems, and asked whether FreeNAS in
particular has any substantial advantages or disadvandages
compared to popular illumos distros (OI, OmniOS) as an OS
for the storage purposes, at home or in business production?
Since there are many BSD folks here, I thought they could
comment about possible advantages of either side, like support
for some ZFS features (I guess cross-pollination is intensive
now and ZFS quality and performance should be very similar
as well as adoption of newly integrated features and bugfixes),
and OS/distro features (service management, driver support,
fault-management (FMA), observability (dtrace, mdb -k), etc.)
Is the choice now more about one's taste and habbits, or are
there some important differences to be aware of (especially
problems, if any)?
Thanks,
//Jim
http://open-zfs.org/wiki/Features
It clearly wasn't done by a FreeBSD person:)
- TRIM support (actually also in ZoL, AFAIK).
- Ability to boot from any ZFS pool (other platforms are limited to one
top-level vdev which can be either disk or a mirror (I hope that's
correct)).
- Quick listing when using options '-o name -s name' - it is at least
100 times faster than alternatives. Very handy when there is huge
number of snapshots.
- ZFS-super-owner - allows regular users to perform file system
operations as root. This is possible when the file system was mounted
by the user, the user is owner of this file system (we force nosuid
option then). Used in FreeBSD netperf cluster, so regular users can
installworld (which set proper ownership of files) to their netbooted
datasets from a build machine.
I'm sure I'm missing some.
PS. Yes, I know I should just put it onto wiki, but if anyone has some
spare cycles I'd be grateful for doing it.
--
Pawel Jakub Dawidek http://www.wheelsystems.com
FreeBSD committer http://www.FreeBSD.org
Am I Evil? Yes, I Am! http://mobter.com
-------------------------------------------
illumos-zfs
Archives: https://www.listbox.com/member/archive/182191/=now
https://www.listbox.com/member/archive/rss/182191/24342081-7731472e
https://www.listbox.com/member/?&
Powered by Listbox: http://www.listbox.com
--
Join the geek side, we have π!

Please feel free to connect with me on LinkedIn.
http://www.linkedin.com/in/samzaydel



-------------------------------------------
illumos-zfs
Archives: https://www.listbox.com/member/archive/182191/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182191/23047029-187a0c8d
Modify Your Subscription: https://www.listbox.com/member/?member_id=23047029&id_secret=23047029-2e85923f
Powered by Listbox: http://www.listbox.com
Freddie Cash
2013-10-09 17:03:32 UTC
Permalink
Post by Sam Zaydel
The question that I think remains unasked and unanswered is how different
is FreeNAS from latest build of FreeBSD. I don't know the answer to this,
but I think that's what is need to help answer the original question.
​FreeNAS 9.1 is based on FreeBSD 9-STABLE (post 9.1-RELEASE). Thus, all
the ZFS features from FreeBSD 9-STABLE are available in FreeNAS 9.1.

The big difference between FreeNAS and FreeBSD is that the former is
treated as an appliance and strictly managed from a web GUI.​
--
Freddie Cash
***@gmail.com



-------------------------------------------
illumos-zfs
Archives: https://www.listbox.com/member/archive/182191/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182191/23047029-187a0c8d
Modify Your Subscription: https://www.listbox.com/member/?member_id=23047029&id_secret=23047029-2e85923f
Powered by Listbox: http://www.listbox.com
aurfalien
2013-10-19 20:51:02 UTC
Permalink
Well, I've messed with both and others (eval phase) and there are no real differences between the 2 other then the GUI in FreeNAS (lovin the easy plugin jail creation as well).

As a CLI advocate, I really like the FreeNAS GUI. In fact its far better then the napp-it GUI in my opinion. Man that thing is a mess.

At any rate, best thing is to try em all for yourself, due diligence is the theme here.

- aurf
The question that I think remains unasked and unanswered is how different is FreeNAS from latest build of FreeBSD. I don't know the answer to this, but I think that's what is need to help answer the original question.
S.
Post by Radio młodych bandytów
Post by Jim Klimov
Hello all,
A colleague of mine is more comfortable with FreeBSD than
Solaris families of systems, and asked whether FreeNAS in
particular has any substantial advantages or disadvandages
compared to popular illumos distros (OI, OmniOS) as an OS
for the storage purposes, at home or in business production?
Since there are many BSD folks here, I thought they could
comment about possible advantages of either side, like support
for some ZFS features (I guess cross-pollination is intensive
now and ZFS quality and performance should be very similar
as well as adoption of newly integrated features and bugfixes),
and OS/distro features (service management, driver support,
fault-management (FMA), observability (dtrace, mdb -k), etc.)
Is the choice now more about one's taste and habbits, or are
there some important differences to be aware of (especially
problems, if any)?
Thanks,
//Jim
http://open-zfs.org/wiki/Features
It clearly wasn't done by a FreeBSD person:)
- TRIM support (actually also in ZoL, AFAIK).
- Ability to boot from any ZFS pool (other platforms are limited to one
top-level vdev which can be either disk or a mirror (I hope that's
correct)).
- Quick listing when using options '-o name -s name' - it is at least
100 times faster than alternatives. Very handy when there is huge
number of snapshots.
- ZFS-super-owner - allows regular users to perform file system
operations as root. This is possible when the file system was mounted
by the user, the user is owner of this file system (we force nosuid
option then). Used in FreeBSD netperf cluster, so regular users can
installworld (which set proper ownership of files) to their netbooted
datasets from a build machine.
I'm sure I'm missing some.
PS. Yes, I know I should just put it onto wiki, but if anyone has some
spare cycles I'd be grateful for doing it.
--
Pawel Jakub Dawidek http://www.wheelsystems.com
FreeBSD committer http://www.FreeBSD.org
Am I Evil? Yes, I Am! http://mobter.com
-------------------------------------------
illumos-zfs
Archives: https://www.listbox.com/member/archive/182191/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182191/24342081-7731472e
Modify Your Subscription: https://www.listbox.com/member/?&
Powered by Listbox: http://www.listbox.com
--
Join the geek side, we have π!
Please feel free to connect with me on LinkedIn. http://www.linkedin.com/in/samzaydel
illumos-zfs | Archives | Modify Your Subscription
-------------------------------------------
illumos-zfs
Archives: https://www.listbox.com/member/archive/182191/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182191/23047029-187a0c8d
Modify Your Subscription: https://www.listbox.com/member/?member_id=23047029&id_secret=23047029-2e85923f
Powered by Listbox: http://www.listbox.com
Matthew Ahrens
2013-10-09 17:09:57 UTC
Permalink
Post by Pawel Jakub Dawidek
Post by Radio młodych bandytów
http://open-zfs.org/wiki/Features
It clearly wasn't done by a FreeBSD person:)
- TRIM support (actually also in ZoL, AFAIK).
- Ability to boot from any ZFS pool (other platforms are limited to one
top-level vdev which can be either disk or a mirror (I hope that's
correct)).
- Quick listing when using options '-o name -s name' - it is at least
100 times faster than alternatives. Very handy when there is huge
number of snapshots.
- ZFS-super-owner - allows regular users to perform file system
operations as root. This is possible when the file system was mounted
by the user, the user is owner of this file system (we force nosuid
option then). Used in FreeBSD netperf cluster, so regular users can
installworld (which set proper ownership of files) to their netbooted
datasets from a build machine.
I'm sure I'm missing some.
PS. Yes, I know I should just put it onto wiki, but if anyone has some
spare cycles I'd be grateful for doing it.
I added it to the Talk page (http://www.open-zfs.org/wiki/Talk:Features).
Would be great if someone from the FreeBSD community could take the time
to verify, format and document these on the Features page.

--matt
Tim Cook
2013-10-09 17:34:26 UTC
Permalink
Post by Matthew Ahrens
Post by Pawel Jakub Dawidek
Post by Radio młodych bandytów
http://open-zfs.org/wiki/Features
It clearly wasn't done by a FreeBSD person:)
- TRIM support (actually also in ZoL, AFAIK).
- Ability to boot from any ZFS pool (other platforms are limited to one
top-level vdev which can be either disk or a mirror (I hope that's
correct)).
- Quick listing when using options '-o name -s name' - it is at least
100 times faster than alternatives. Very handy when there is huge
number of snapshots.
- ZFS-super-owner - allows regular users to perform file system
operations as root. This is possible when the file system was mounted
by the user, the user is owner of this file system (we force nosuid
option then). Used in FreeBSD netperf cluster, so regular users can
installworld (which set proper ownership of files) to their netbooted
datasets from a build machine.
I'm sure I'm missing some.
PS. Yes, I know I should just put it onto wiki, but if anyone has some
spare cycles I'd be grateful for doing it.
I added it to the Talk page (http://www.open-zfs.org/wiki/Talk:Features).
Would be great if someone from the FreeBSD community could take the time
to verify, format and document these on the Features page.
--matt
From a downside perspective I beleive FreeBSD still has no solid block
target stack. I believe SpectraLogic gave some code to the effort but it's
not yet fully baked? There's also no ALUA support that I'm aware of - GEOM
only supports active/passive pathing.

From the NAS side of things, FreeBSD has no concept of an in-kernel
licensed CIFS stack, it relies on SAMBA. The one thing I would say on this
front is it's likely to be less of a concern as SAMBA embraces SMB3. I
don't see any way that the in-kernel stack in illumos is getting smb3
support unless there's work and money behind it I'm not aware of.

I also don't believe FreeBSD has any support for nfsv4 or 4.1/pnfs. It's
admittedly been a while since I've played with running it as a server so
some or all of the above may have been addressed. I'll leave it to someone
like Pawel to correct me where I'm wrong.

--Tim
Freddie Cash
2013-10-09 18:07:20 UTC
Permalink
Post by Tim Cook
From a downside perspective I beleive FreeBSD still has no solid block
target stack. I believe SpectraLogic gave some code to the effort but it's
not yet fully baked? There's also no ALUA support that I'm aware of - GEOM
only supports active/passive pathing.
From the NAS side of things, FreeBSD has no concept of an in-kernel
licensed CIFS stack, it relies on SAMBA. The one thing I would say on this
front is it's likely to be less of a concern as SAMBA embraces SMB3. I
don't see any way that the in-kernel stack in illumos is getting smb3
support unless there's work and money behind it I'm not aware of.
I also don't believe FreeBSD has any support for nfsv4 or 4.1/pnfs. It's
admittedly been a while since I've played with running it as a server so
some or all of the above may have been addressed. I'll leave it to someone
like Pawel to correct me where I'm wrong.
​FreeBSD has NFSv4 client and server support. Has for awhile now. I
believe it's experimental in 8.x and default in 9.x?

And Rick Maclem (hope I spelt that right) has NFSv4.1 client support
available for testing in 10.x? At least, I vaguely remember a head's up
about it around a month or so ago.
--
Freddie Cash
***@gmail.com
Rick Macklem
2013-10-10 12:43:01 UTC
Permalink
Post by Freddie Cash
Post by Tim Cook
From a downside perspective I beleive FreeBSD still has no solid block
target stack. I believe SpectraLogic gave some code to the effort but it's
not yet fully baked? There's also no ALUA support that I'm aware of - GEOM
only supports active/passive pathing.
From the NAS side of things, FreeBSD has no concept of an in-kernel
licensed CIFS stack, it relies on SAMBA. The one thing I would say on this
front is it's likely to be less of a concern as SAMBA embraces SMB3. I
don't see any way that the in-kernel stack in illumos is getting smb3
support unless there's work and money behind it I'm not aware of.
I also don't believe FreeBSD has any support for nfsv4 or 4.1/pnfs.
It's
admittedly been a while since I've played with running it as a server so
some or all of the above may have been addressed. I'll leave it to someone
like Pawel to correct me where I'm wrong.
​FreeBSD has NFSv4 client and server support. Has for awhile now. I
believe it's experimental in 8.x and default in 9.x?
And Rick Maclem (hope I spelt that right) has NFSv4.1 client support
available for testing in 10.x? At least, I vaguely remember a head's up
about it around a month or so ago.
Yes, the 4.1 client side (including pNFS support for File Layouts only)
is in 10.0. There is server code in projects/nfsv4.1-server, but it does
not include pNFS (and I don't plan on trying to do pNFS support, since
it is a major project). The main piece missing from the NFSv4.1 server
is backchannel support (for callbacks) in sessions and I am currently
working on that.

rick
Post by Freddie Cash
--
Freddie Cash
_______________________________________________
http://lists.freebsd.org/mailman/listinfo/freebsd-fs
Justin T. Gibbs
2013-10-09 18:29:20 UTC
Permalink
Post by Pawel Jakub Dawidek
Post by Radio młodych bandytów
http://open-zfs.org/wiki/Features
It clearly wasn't done by a FreeBSD person:)
- TRIM support (actually also in ZoL, AFAIK).
- Ability to boot from any ZFS pool (other platforms are limited to one
top-level vdev which can be either disk or a mirror (I hope that's
correct)).
- Quick listing when using options '-o name -s name' - it is at least
100 times faster than alternatives. Very handy when there is huge
number of snapshots.
- ZFS-super-owner - allows regular users to perform file system
operations as root. This is possible when the file system was mounted
by the user, the user is owner of this file system (we force nosuid
option then). Used in FreeBSD netperf cluster, so regular users can
installworld (which set proper ownership of files) to their netbooted
datasets from a build machine.
I'm sure I'm missing some.
PS. Yes, I know I should just put it onto wiki, but if anyone has some
spare cycles I'd be grateful for doing it.
I added it to the Talk page (http://www.open-zfs.org/wiki/Talk:Features). Would be great if someone from the FreeBSD community could take the time to verify, format and document these on the Features page.
--matt
From a downside perspective I beleive FreeBSD still has no solid block target stack.
A new, in kernel, iSCSI target and initiator stack (funded by the FreeBSD Foundation) is available in FreeBSD/head and will be included in FreeBSD 10. It makes use of the FreeBSD CAM Target Layer (CTL) stack (sponsored by Copan/SGI and SpectraLogic) which is similar to COMSTAR.
Post by Pawel Jakub Dawidek
I believe SpectraLogic gave some code to the effort but it's not yet fully baked?
The code from Spectra makes block serving more efficient. It is fully baked, but not yet upstreamed.
Post by Pawel Jakub Dawidek
There's also no ALUA support that I'm aware of - GEOM only supports active/passive pathing.
From the NAS side of things, FreeBSD has no concept of an in-kernel licensed CIFS stack, it relies on SAMBA.
Spectra relies on the Likewise stack. If there are others interested in running this on FreeBSD, please contact me. We've been planning for some time to push our version of Likewise out on GitHub or something similar to get more collaboration on improving it. Although not in kernel, it does have very good performance.
Post by Pawel Jakub Dawidek
The one thing I would say on this front is it's likely to be less of a concern as SAMBA embraces SMB3. I don't see any way that the in-kernel stack in illumos is getting smb3 support unless there's work and money behind it I'm not aware of.
So long as Samba remains GPLv3, there will be interest in developing an alternative.

--
Justin
Richard Yao
2013-10-09 19:25:21 UTC
Permalink
From the NAS side of things, FreeBSD has no concept of an in-kernel licensed CIFS stack, it relies on SAMBA. The one thing I would say on this front is it's likely to be less of a concern as SAMBA embraces SMB3. I don't see any way that the in-kernel stack in illumos is getting smb3 support unless there's work and money behind it I'm not aware of.
I was under the impression that Nexenta was developing its own SMB server with SMB3 support. Someone correct me if I am wrong.
Garrett D'Amore
2013-10-09 21:16:43 UTC
Permalink
I really should get on the ball and implement the unmap and trim support needed in sd for ZFS in illumos. So many projects and so few round toits.

Sent from my iPhone
Post by Pawel Jakub Dawidek
Post by Radio młodych bandytów
Post by Jim Klimov
Hello all,
A colleague of mine is more comfortable with FreeBSD than
Solaris families of systems, and asked whether FreeNAS in
particular has any substantial advantages or disadvandages
compared to popular illumos distros (OI, OmniOS) as an OS
for the storage purposes, at home or in business production?
Since there are many BSD folks here, I thought they could
comment about possible advantages of either side, like support
for some ZFS features (I guess cross-pollination is intensive
now and ZFS quality and performance should be very similar
as well as adoption of newly integrated features and bugfixes),
and OS/distro features (service management, driver support,
fault-management (FMA), observability (dtrace, mdb -k), etc.)
Is the choice now more about one's taste and habbits, or are
there some important differences to be aware of (especially
problems, if any)?
Thanks,
//Jim
http://open-zfs.org/wiki/Features
It clearly wasn't done by a FreeBSD person:)
- TRIM support (actually also in ZoL, AFAIK).
- Ability to boot from any ZFS pool (other platforms are limited to one
top-level vdev which can be either disk or a mirror (I hope that's
correct)).
- Quick listing when using options '-o name -s name' - it is at least
100 times faster than alternatives. Very handy when there is huge
number of snapshots.
- ZFS-super-owner - allows regular users to perform file system
operations as root. This is possible when the file system was mounted
by the user, the user is owner of this file system (we force nosuid
option then). Used in FreeBSD netperf cluster, so regular users can
installworld (which set proper ownership of files) to their netbooted
datasets from a build machine.
I'm sure I'm missing some.
PS. Yes, I know I should just put it onto wiki, but if anyone has some
spare cycles I'd be grateful for doing it.
--
Pawel Jakub Dawidek http://www.wheelsystems.com
FreeBSD committer http://www.FreeBSD.org
Am I Evil? Yes, I Am! http://mobter.com
-------------------------------------------
illumos-zfs
Archives: https://www.listbox.com/member/archive/182191/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182191/22035932-85c5d227
Modify Your Subscription: https://www.listbox.com/member/?&
Powered by Listbox: http://www.listbox.com
Robert Milkowski
2013-10-11 12:28:51 UTC
Permalink
Post by Pawel Jakub Dawidek
A colleague of mine is more comfortable with FreeBSD than Solaris
families of systems, and asked whether FreeNAS in particular has
...
Post by Pawel Jakub Dawidek
- TRIM support (actually also in ZoL, AFAIK).
And it is also in Solaris 11
Darren Reed
2013-10-15 11:31:01 UTC
Permalink
Post by Robert Milkowski
Post by Pawel Jakub Dawidek
A colleague of mine is more comfortable with FreeBSD than Solaris
families of systems, and asked whether FreeNAS in particular has
...
Post by Pawel Jakub Dawidek
- TRIM support (actually also in ZoL, AFAIK).
And it is also in Solaris 11
So?
Does anyone actually care what Solaris does any more?

Darren
Gary Driggs
2013-10-15 14:38:06 UTC
Permalink
Post by Darren Reed
Does anyone actually care what Solaris does any more?
It's not as if they've stopped innovating -- they just aren't sharing
with the rest of the class.

-Gary
Schlacta, Christ
2013-10-15 14:43:49 UTC
Permalink
Solaris still does stuff? O,.,o
Post by Darren Reed
A colleague of mine is more comfortable with FreeBSD than Solaris
Post by Pawel Jakub Dawidek
families of systems, and asked whether FreeNAS in particular has
...
Post by Pawel Jakub Dawidek
- TRIM support (actually also in ZoL, AFAIK).
And it is also in Solaris 11
So?
Does anyone actually care what Solaris does any more?
Darren
------------------------------**-------------
illumos-zfs
Archives: https://www.listbox.com/**member/archive/182191/=now<https://www.listbox.com/member/archive/182191/=now>
RSS Feed: https://www.listbox.com/**member/archive/rss/182191/**
23054485-60ad043a<https://www.listbox.com/member/archive/rss/182191/23054485-60ad043a>
Modify Your Subscription: https://www.listbox.com/**
member/?&id_**secret=23054485-335460f5<https://www.listbox.com/member/?&>
Powered by Listbox: http://www.listbox.com
-------------------------------------------
illumos-zfs
Archives: https://www.listbox.com/member/archive/182191/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182191/23047029-187a0c8d
Modify Your Subscription: https://www.listbox.com/member/?member_id=23047029&id_secret=23047029-2e85923f
Powered by Listbox: http://www.listbox.com
Eugen Leitl
2013-10-15 14:46:07 UTC
Permalink
Post by Schlacta, Christ
Solaris still does stuff? O,.,o
Oracle is certainly doing "stuff"

http://www.theregister.co.uk/2013/10/15/oracle_says_open_source_has_no_place_in_military_apps/
m
2013-10-15 16:32:20 UTC
Permalink
Post by Eugen Leitl
Post by Schlacta, Christ
Solaris still does stuff? O,.,o
Oracle is certainly doing "stuff"
http://www.theregister.co.uk/2013/10/15/oracle_says_open_source_has_no_place_in_military_apps/
people used to call that "stuff" as "FUD" if I am not mistaken
--
.*. finelli
/V\
(/ \) --------------------------------------------------------------
( ) Linux: Friends dont let friends use Piccolosoffice
^^-^^ --------------------------------------------------------------
Gary Driggs
2013-10-15 16:08:17 UTC
Permalink
They obviously haven't talked to any of the sysadmins at Craigslist,
Google, Amazon, Facebook, et al if Oracle thinks they have a monopoly
on scaling open source stacks. I think their /arguments/ don't scale
well.

-Gary
Tim Cook
2013-10-15 16:30:01 UTC
Permalink
Post by Darren Reed
A colleague of mine is more comfortable with FreeBSD than Solaris
Post by Pawel Jakub Dawidek
families of systems, and asked whether FreeNAS in particular has
...
Post by Pawel Jakub Dawidek
- TRIM support (actually also in ZoL, AFAIK).
And it is also in Solaris 11
So?
Does anyone actually care what Solaris does any more?
Darren
At one point in time I'd have said "sure, there's plenty of people running
Solaris in production and Illumos on the side", but at this point - with
Oracle closing down their mailing list and trying to move people to the new
trash, I'd have to agree. They aren't sharing the code, they created their
own walled community - who cares? They wanted their walled garden, they
got it. I celebrate every quarter when I see that hardware revenue number
continue to tank. Larry sucks.

--Tim



-------------------------------------------
illumos-zfs
Archives: https://www.listbox.com/member/archive/182191/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182191/23047029-187a0c8d
Modify Your Subscription: https://www.listbox.com/member/?member_id=23047029&id_secret=23047029-2e85923f
Powered by Listbox: http://www.listbox.com
Matthew Ahrens
2013-10-15 17:13:37 UTC
Permalink
I celebrate every quarter when I see that hardware revenue number continue
to tank. Larry sucks.
While I appreciate your other points (e.g. "Oracle closing down their
mailing list"), I don't think we should celebrate the demise of others, nor
engage in personal attacks.

--matt



-------------------------------------------
illumos-zfs
Archives: https://www.listbox.com/member/archive/182191/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182191/23047029-187a0c8d
Modify Your Subscription: https://www.listbox.com/member/?member_id=23047029&id_secret=23047029-2e85923f
Powered by Listbox: http://www.listbox.com
Eugen Leitl
2013-10-15 19:23:09 UTC
Permalink
Post by Matthew Ahrens
While I appreciate your other points (e.g. "Oracle closing down their
mailing list"), I don't think we should celebrate the demise of others, nor
engage in personal attacks.
Given the what happened post-Sun and elsewhere, that's not ad hominem.
That's a statement of fact. Any open source software Oracle touches
will shrivel on the vine, and needs to be forked in order to survive.
Gary Driggs
2013-10-15 21:08:09 UTC
Permalink
Any open source software Oracle touches will shrivel on the vine, and needs to be forked in order to survive.
Even BerkleyDB, MySQL, and VirtualBox? They seem to be chugging right
along with regular releases.

-Gary
Alan Somers
2013-10-15 21:38:33 UTC
Permalink
Post by Gary Driggs
Any open source software Oracle touches will shrivel on the vine, and needs to be forked in order to survive.
Even BerkleyDB, MySQL, and VirtualBox? They seem to be chugging right
along with regular releases.
Have you read the news? Oracle is strangling MySQL too.

http://www.theregister.co.uk/2012/11/29/monty_oracle_eu_promises/
http://www.mysqlperformanceblog.com/2012/08/16/where-to-get-a-bzr-tree-of-the-latest-mysql-releases/

-Alan
Eugen Leitl
2013-10-16 05:57:43 UTC
Permalink
Post by Gary Driggs
Any open source software Oracle touches will shrivel on the vine, and needs to be forked in order to survive.
Even BerkleyDB, MySQL, and VirtualBox? They seem to be chugging right
MySQL is no more, there's MariaDB. VirtualBox is the one apparent exemption
from the general rule, so far.
Post by Gary Driggs
along with regular releases.
aurfalien
2013-10-19 20:54:27 UTC
Permalink
I celebrate every quarter when I see that hardware revenue number continue to tank. Larry sucks.
While I appreciate your other points (e.g. "Oracle closing down their mailing list"), I don't think we should celebrate the demise of others, nor engage in personal attacks.
--matt
Fo Sho.

I still harken over SGI, OMG trgic!

So yea, if Solaris truly tanks, I think it will suck ofr the industry in general; fewer choices.

- aurf


-------------------------------------------
illumos-zfs
Archives: https://www.listbox.com/member/archive/182191/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182191/23047029-187a0c8d
Modify Your Subscription: https://www.listbox.com/member/?member_id=23047029&id_secret=23047029-2e85923f
Powered by Listbox: http://www.listbox.com
Paul B. Henson
2013-10-15 19:14:44 UTC
Permalink
Sent: Tuesday, October 15, 2013 4:31 AM
Does anyone actually care what Solaris does any more?
Well, in the context of at any given time it's nice to be able to say "openZFS kicks proprietary ZFS' ass" ;), keeping track of any interesting enhancements in Oracle Solaris and potentially duplicating or improving on them in openZFS seems a worthwhile endeavor :).
aurfalien
2013-10-19 20:58:20 UTC
Permalink
Post by Paul B. Henson
Sent: Tuesday, October 15, 2013 4:31 AM
Does anyone actually care what Solaris does any more?
Well, in the context of at any given time it's nice to be able to say "openZFS kicks proprietary ZFS' ass" ;)
It does?

So far my testing of both (closed ZFS at v34) and open ZFS at v5000 seems to indicate they are roughly the same in general IO.

I plan to drill down more in the following weeks.

- aurf
Robert Milkowski
2013-10-15 23:58:20 UTC
Permalink
-----Original Message-----
Sent: 15 October 2013 12:31
Subject: Re: [zfs] BSD ZFS vs. illumos ZFS
Post by Robert Milkowski
Post by Pawel Jakub Dawidek
Post by Jim Klimov
A colleague of mine is more comfortable with FreeBSD than
Solaris
Post by Robert Milkowski
Post by Pawel Jakub Dawidek
Post by Jim Klimov
families of systems, and asked whether FreeNAS in particular has
...
Post by Pawel Jakub Dawidek
- TRIM support (actually also in ZoL, AFAIK).
And it is also in Solaris 11
So?
Does anyone actually care what Solaris does any more?
Of course. Many enterprises are using Solaris 11 and not necessarily Illumos based distros.
Can I install Sybase on Illumos based distro on ZFS and get a fully supported configuration...?

Then there is lots of development going into Solaris 11 and ZFS in particular.

I think many folks are using ZFS these days both on Solaris 11 and Illumos based distros (and other platforms like BSD and Linux) and it is good to know what features are available on which OS.
--
Best regards
Robert Milkowski
Darren Reed
2013-10-16 10:52:03 UTC
Permalink
Post by Tim Cook
I celebrate every quarter when I see that hardware revenue number
continue to tank. Larry sucks.
While I appreciate your other points (e.g. "Oracle closing down their
mailing list"), I don't think we should celebrate the demise of
others, nor engage in personal attacks.
+1.
Post by Tim Cook
-----Original Message-----
Sent: 15 October 2013 12:31
Subject: Re: [zfs] BSD ZFS vs. illumos ZFS
Post by Robert Milkowski
Post by Pawel Jakub Dawidek
Post by Jim Klimov
A colleague of mine is more comfortable with FreeBSD than
Solaris
Post by Robert Milkowski
Post by Pawel Jakub Dawidek
Post by Jim Klimov
families of systems, and asked whether FreeNAS in particular has
...
Post by Pawel Jakub Dawidek
- TRIM support (actually also in ZoL, AFAIK).
And it is also in Solaris 11
So?
Does anyone actually care what Solaris does any more?
Of course. Many enterprises are using Solaris 11 and not necessarily Illumos based distros.
Can I install Sybase on Illumos based distro on ZFS and get a fully supported configuration...?
No, but neither do you have to use Solaris: there are RHEL solutions
that fit. And if it is the application that is important, then the
operating system is really only as important as the BIOS.
Post by Tim Cook
Then there is lots of development going into Solaris 11 and ZFS in particular.
I think many folks are using ZFS these days both on Solaris 11 and Illumos based distros (and other platforms like BSD and Linux) and it is good to know what features are available on which OS.
It no longer matters if there is or isn't any development going into
Solaris as they've taken their ball and gone away to play by themselves.
Further to that, they're now going around telling everyone else how the
people that they used to play with are now not good people to play with.
Not very nice.

With children you might try to reach out to them, to encourage them to
learn to behave but that's not going to work as the direction comes from
Solaris's newly adopted parents.

At this point I'm starting to wonder if the best thing that the entire
open source community can do is completely ignore Solaris and wait until
its parents realise their mistake. A rather sad state of affairs, really.

I suppose the greater point of my comment is that we should no longer be
looking for direction from Solaris or being concerned with which
features it does or doesn't have. Illumos (and by extension open source
platforms using illumos technology such as ZFS & dtrace) needs to make
its own.

Darren
Jim Klimov
2013-10-16 11:53:33 UTC
Permalink
Post by Darren Reed
Post by Robert Milkowski
Can I install Sybase on Illumos based distro on ZFS and get a fully supported configuration...?
No, but neither do you have to use Solaris: there are RHEL solutions
that fit. And if it is the application that is important, then the
operating system is really only as important as the BIOS.
And would you trust your production database (or any useful data) to
anything other than ZFS? Is ZOL available on RHEL (I have no idea)
as part of the "supported" distribution? Is "The Application" on RHEL
stored in ZOL ZFS a certified supported configuration (sometimes it
is not enough to be certified just under a given OS, details may
matter - this was part of ZFS vs. UFS in Solaris history as well)?
Post by Darren Reed
I suppose the greater point of my comment is that we should no longer be
looking for direction from Solaris or being concerned with which
features it does or doesn't have. Illumos (and by extension open source
platforms using illumos technology such as ZFS & dtrace) needs to make
its own.
I'd speculate about one thing which contradicts your statement: Oracle
(as a corporate entity) is a well-earning company. They don't invest
into stuff they think is not profitable (causes are a separate matter -
i.e. they had no idea how to sell SunRays or some software to accounts
under several thousand heads at once, and/or no intention to do so,
which rules out many rich but small companies from being clients, and
may lead to demise of some great products and technologies that were
not open-sourced in time).

So whatever features they chose to promote in their ZFS are probably
those desired and backed by paying customers - perhaps with hundred
of votes behind each RFE or bugfix. And not all are about database
integration for ZFS SA ;)

And if the illumos community (and OpenZFS in this case) wants to win
over part of that market, the Lawnmower's progress should be tracked.
Functional equivalents of some of their features may need to be made
(say, dataset encryption), so that sales comparisons are not that the
customer can get some tasty features from Oracle, and other good stuff
from (cheaper) open-source, and has to pick feature-wise, but rather
that there are all of these in OpenZFS, and then some more.

Of course, there are many other criteria (support, single-vendor bulk
discounts, formal certifications, compliance, maybe accreditation and
security clearances, etc.) that might let the choice sometimes be
against the OpenZFS distributions, but lack of some really useful
features should not be among such reasons.

My 2c,
//Jim Klimov
Darren Reed
2013-10-16 14:22:27 UTC
Permalink
Post by Jim Klimov
Post by Darren Reed
Post by Robert Milkowski
Can I install Sybase on Illumos based distro on ZFS and get a fully
supported configuration...?
No, but neither do you have to use Solaris: there are RHEL solutions
that fit. And if it is the application that is important, then the
operating system is really only as important as the BIOS.
And would you trust your production database (or any useful data) to
anything other than ZFS?
Yes. There are commercial grade file servers and file systems (NetApp &
WAFL) that come to mind. EMC, IBM and others also probably have
something to offer in that space.
Post by Jim Klimov
Post by Darren Reed
I suppose the greater point of my comment is that we should no longer be
looking for direction from Solaris or being concerned with which
features it does or doesn't have. Illumos (and by extension open source
platforms using illumos technology such as ZFS & dtrace) needs to make
its own.
I'd speculate about one thing which contradicts your statement: Oracle
(as a corporate entity) is a well-earning company. They don't invest
into stuff they think is not profitable...
What's that got to do with an open source community?
Post by Jim Klimov
So whatever features they chose to promote in their ZFS are probably
those desired and backed by paying customers - perhaps with hundred
of votes behind each RFE or bugfix. And not all are about database
integration for ZFS SA ;)
You're missing an important word in that paragraph. It should read:
"... backed by their paying customers -"

So let me get this straight. Because the new owner of Solaris makes a
good profit, whatever antisocial behaviour they exhibit towards open
source communities is justified and should be used as a role model? Are
you serious?
Post by Jim Klimov
And if the illumos community (and OpenZFS in this case) wants to win
over part of that market, the Lawnmower's progress should be tracked.
Functional equivalents of some of their features may need to be made
(say, dataset encryption), so that sales comparisons are not that the
customer can get some tasty features from Oracle, and other good stuff
from (cheaper) open-source, and has to pick feature-wise, but rather
that there are all of these in OpenZFS, and then some more.
Wouldn't it be better to behave as they do and base the features
supported on the number of requests for them rather than simply copying
what someone else does in the hope that you can ride the other's coat tails?

Surely it makes sense to tend to your own flock first and make sure that
it is happy, yes?

On the other hand, if the end game for companies such as Delphix & other
illumos/opensolaris spinoffs is to be bought back and folded in then
sure, copying those other features is important for the spinoffs.

Darren
Jim Klimov
2013-10-16 14:11:00 UTC
Permalink
Whoa, we suddenly banged the horns... I don't want this to be a
conflict, but rather a respectable constructive discussion :)
Post by Darren Reed
Yes. There are commercial grade file servers and file systems (NetApp &
WAFL) that come to mind. EMC, IBM and others also probably have
something to offer in that space.
Well, ZFS marketing (including from Sun and Oracle) sets presence of
checksums as an important differentiator between ZFS and other storage
solutions. And as that FUD-talk said, the "simple washing powder" (I
mean classic RAID systems) is only good if the whole disk kicks the
bucket, or at least a sector read does return a HW error. Otherwise
this turns into a guess-game of which copy (or RAID reconstruction)
of the data to trust in case of discrepancies that are not accompanied
by HW errors.

I do no know how other vendors solve this problem, and if they do.

I did have simple RAIDs go astray (Linux md and mirroring on the
motherboard, maybe Solaris SVM - though not so sure) when both halves
of the mirror were readable but contained different data. This led to
the reads either returning invalid (randomly chosen) data half of the
time, or (during resync) one disk arbitrarily being chosen as the
master copy to overwrite the other disk. So, at least for some cases,
the ZFS marketing's description of "classic RAID" was correct - it
does have the problem with hidden data rot without diagnosed errors.

DO, to your knowledge, any other solutions provide protection against
such class of situations (they do happen, verified)? Or do they just
rely on expensive hardware that is less likely to break or lie - with
no means to verify that it did not?
Post by Darren Reed
"... backed by *their* paying customers -"
Yes, you are right, I missed it... but...

Whose customer one is today - this is not necessarily permanent.
Some want to hop onboard, others want to jump ship - and OpenZFS
might be the boat they'd sail next. So in a year or two they might
be (free or paying) customers of one of the illumos/OpenZFS vendors.
If they bring along money, or code, or word-spreading efforts - so
much the better.
Post by Darren Reed
So let me get this straight. Because the new owner of Solaris makes a
good profit, whatever antisocial behaviour they exhibit towards open
source communities is justified and should be used as a role model? Are
you serious?
No. Role-modeling - hell no, and I am sorry if anything I said could
be interpreted that I did imply that :)

Tracking what they do, just like being aware of any other interesting
developments in the storage industry or things related to ZFS, may lead
to implementing something that is desired by our potential customers.
Say, some of this list member's track what new optimizations come up
with cryptography and particular algorithms, and some of these make way
into OpenZFS for checksums, to make it faster.

Taking the offer to ignore Oracle to the extreme: would you propose,
alternately, that we hide in a shell and only implement things that
we thought up and believe are cool, regardless of whether anyone
else wants them, or that our users do want something else too?

There are likely things in Solaris ZFS that are irrelevant to the
OpenZFS community in general (like, say, integration with OracleDB),
and there are things which (or similar to which) we might welcome
in the open.
Post by Darren Reed
Wouldn't it be better to behave as they do and base the features
supported on the number of requests for them rather than simply copying
what someone else does in the hope that you can ride the other's coat tails?
There's time for both strategies. I don't advocate for only copying,
nor for only making stuff based on RFE votes (say, Saso makes a lot
of great stuff without an immediate commercial gain, AFAIK, just as
an enthusiast; while up-streamed bugfixes from companies originate
mostly as fixes to things that plagued their paying customers).
Post by Darren Reed
Surely it makes sense to tend to your own flock first and make sure that
it is happy, yes?
And if your flock wants what those guys behind the fence have got?..
Post by Darren Reed
On the other hand, if the end game for companies such as Delphix & other
illumos/opensolaris spinoffs is to be bought back and folded in then
sure, copying those other features is important for the spinoffs.
I hope this is not The Plan :)

//Jim
Robert Milkowski
2013-10-17 09:57:11 UTC
Permalink
-----Original Message-----
Sent: 16 October 2013 15:22
Subject: Re: [zfs] BSD ZFS vs. illumos ZFS
Post by Jim Klimov
Post by Darren Reed
Post by Robert Milkowski
Can I install Sybase on Illumos based distro on ZFS and get a fully
supported configuration...?
No, but neither do you have to use Solaris: there are RHEL solutions
that fit. And if it is the application that is important, then the
operating system is really only as important as the BIOS.
And would you trust your production database (or any useful data) to
anything other than ZFS?
Yes. There are commercial grade file servers and file systems (NetApp &
WAFL) that come to mind. EMC, IBM and others also probably have
something to offer in that space.
Sure, all of them do. At the end it is mainly down to business reasons - is NetApp or EMC based solution going to be cheaper than x86+Solaris11+ZFS? From my experience this is very unlikely. Then ZFS tends to compress much better with gzip (more often than not still providing acceptable performance) which makes it even cheaper solution. Sure, it doesn't matter that much for a 10GB database, but it does for a 1TB one or bigger.
Richard Yao
2013-10-16 15:02:22 UTC
Permalink
Post by Jim Klimov
And if the illumos community (and OpenZFS in this case) wants to win
over part of that market, the Lawnmower's progress should be tracked.
Functional equivalents of some of their features may need to be made
(say, dataset encryption), so that sales comparisons are not that the
customer can get some tasty features from Oracle, and other good stuff
from (cheaper) open-source, and has to pick feature-wise, but rather
that there are all of these in OpenZFS, and then some more.
Fighting for use among the people who think ZFS is cool will not increase ZFS's overall market share. If we want to increase ZFS's market share, it would be better to focus on competition with other filesystems, such as SGI's XFS and Microsoft's NTFS.

This preoccupation with Oracle seems to parallel the UNIX wars, where vendors were so busy competing with each other that they never bothered to grow the UNIX market. Lets not do that with ZFS. It is too cool to pigeonhole.

By the way, pursuing marketshare from other filesystems would parallel Apple versus Microsoft, where Open ZFS is Apple and Oracle is Microsoft. Going after bigger, better, things like Apple did makes the Microsoft of the industry irrelevant.
Rich Teer
2013-10-16 15:08:22 UTC
Permalink
Post by Richard Yao
Fighting for use among the people who think ZFS is cool will not
increase ZFS's overall market share. If we want to increase ZFS's
market share, it would be better to focus on competition with other
filesystems, such as SGI's XFS and Microsoft's NTFS.
This preoccupation with Oracle seems to parallel the UNIX wars,
where vendors were so busy competing with each other that they never
bothered to grow the UNIX market. Lets not do that with ZFS. It is
too cool to pigeonhole.
I think these two points are key to the whole ZFS-adoption question.

Let's work on making ZFS omnipresent, and relegate worrying about Oracle
to the back burner. Keep an eye on what they do for inspiration of new
features, sure, but let's steer our own ship.
--
Rich Teer, Publisher
Vinylphile Magazine

www.vinylphilemag.com
Jim Klimov
2013-10-16 15:14:43 UTC
Permalink
Post by Rich Teer
Let's work on making ZFS omnipresent, and relegate worrying about Oracle
to the back burner. Keep an eye on what they do for inspiration of new
features, sure, but let's steer our own ship.
A nice short summary of this subject in the overall thread :)
(i.e. "keep an eye" = yes, "ignore/irrelevant" = no)
+1
//Jim
Paul Kraus
2013-10-16 12:59:34 UTC
Permalink
Changing subject to match content ...
At this point I'm starting to wonder if the best thing that the entire open source community can do is completely ignore Solaris and wait until its parents realise their mistake. A rather sad state of affairs, really.
There is an assumption above that may or may not be true, that taking Solaris back behind closed doors was a mistake. Having worked for many years with both Open and Closed systems, there are pros and cons to each. I am not convinced there is a clear winner in terms of cost to the business. Closed solutions cost more for the software / hardware and support, but Open solutions cost more in terms of man hours that will have to be spent creating a solution comparable to the Closed solution. Each "customer" needs to make their own decisions and weigh the options.

I believe in Open solutions, I just do not believe that they are the *only* solution.
I suppose the greater point of my comment is that we should no longer be looking for direction from Solaris or being concerned with which features it does or doesn't have. Illumos (and by extension open source platforms using illumos technology such as ZFS & dtrace) needs to make its own.
I do not think the Open ZFS community should be looking only to Oracle for direction, but we should certainly be paying attention to what Oracle is doing with ZFS and more importantly, *why*. If Oracle thinks that feature X is important for reasons beyond "customers with lots of money want it", then maybe it would be a useful feature for Open ZFS as well. But we should NOT just be trying to mimic what Oracle is doing.

Another note about Solaris vs. Illumos, Oracle has made it very clear that they are not in the least concerned with customers below the Fortune Top 500, maybe even the Top 100 or 50. That leaves *lots* of the market for a solid alternative. ZFS is a very compelling feature. I am running a number of FreeBSD systems *because* I could have ZFS on hardware that Illumos just did not run on (even though it was listed on the HCL and I really *wanted* to run Illumos). I have low cost snapshots and remote replication and a real trust that my data (and my client's data) is not being corrupted. Did these Open solutions cost less than Solaris would have ? Probably not, but clients (at least mine) are much more willing to spend money on consulting over time than product all at once.

--
Paul Kraus
Deputy Technical Director, LoneStarCon 3
Sound Coordinator, Schenectady Light Opera Company
Robert Milkowski
2013-10-17 09:49:19 UTC
Permalink
Post by Robert Milkowski
Post by Robert Milkowski
Of course. Many enterprises are using Solaris 11 and not necessarily
Illumos based distros.
Post by Robert Milkowski
Can I install Sybase on Illumos based distro on ZFS and get a fully
supported configuration...?
No, but neither do you have to use Solaris: there are RHEL solutions
that fit. And if it is the application that is important, then the
operating system is really only as important as the BIOS.
Well, what if the database is hundreds of TBs in size and when installed on ZFS with compression it suddenly needs 6x disk space while still providing acceptable performance? That's a very big cost saving... (yes, there is a build-in compression in Sybase but at least in this case it doesn't compress data nowhere near as good as zfs).

So yes, OS does matter (ZFS in this case) as it helps save lots of money.
And no, you can't do it on RHEL with full support and/or stability - neither ZoL nor BTRFS are there.
And Solaris 11 for environments like that is the best option for now.
Post by Robert Milkowski
Post by Robert Milkowski
Then there is lots of development going into Solaris 11 and ZFS in
particular.
Post by Robert Milkowski
I think many folks are using ZFS these days both on Solaris 11 and
Illumos based distros (and other platforms like BSD and Linux) and it
is good to know what features are available on which OS.
It no longer matters if there is or isn't any development going into
Solaris as they've taken their ball and gone away to play by
themselves.
Open Source is not a panacea to everything. While I do regret than Solaris is no longer open source, in practise it doesn't matter that much. Is your iPhone open sourced? No, yet still it is a great product. Sun did open source most of the Solaris and it didn't really help it either.
Post by Robert Milkowski
At this point I'm starting to wonder if the best thing that the entire
open source community can do is completely ignore Solaris and wait
until its parents realise their mistake. A rather sad state of affairs,
really.
I think you are unnecessarily too emotional about the whole thing.
Post by Robert Milkowski
I suppose the greater point of my comment is that we should no longer
be looking for direction from Solaris or being concerned with which
features it does or doesn't have. Illumos (and by extension open source
platforms using illumos technology such as ZFS & dtrace) needs to make
its own.
You personally might not be interested, like many people are not interested on features lets say in BSD or some other operating system. The point is that there are many ZFS users using different platforms and many of them are interested at what options are available. And while Illumos or BSD or even ZoL are better solutions for some use cases, there are other use cases where Solaris 11 is better and is worth paying money for.
Eugen Leitl
2013-10-17 10:10:28 UTC
Permalink
Post by Robert Milkowski
Well, what if the database is hundreds of TBs in size and when installed on ZFS with compression it suddenly needs 6x disk space while still providing acceptable performance? That's a very big cost saving... (yes, there is a build-in compression in Sybase but at least in this case it doesn't compress data nowhere near as good as zfs).
zfs compression is available e.g. in OmniOS. As soon as
decent encryption is there it's basically feature
complete (meanwhile, there are workarounds like
http://www.napp-it.org/extensions/encryption.html ).
Post by Robert Milkowski
So yes, OS does matter (ZFS in this case) as it helps save lots of money.
And no, you can't do it on RHEL with full support and/or stability - neither ZoL nor BTRFS are there.
And Solaris 11 for environments like that is the best option for now.
I can only see a point in "nobody ever got fired for buying Orkcackle" and
"we have no in-house clue but plenty of money and our system is mission critical".
Post by Robert Milkowski
Post by Darren Reed
It no longer matters if there is or isn't any development going into
Solaris as they've taken their ball and gone away to play by
themselves.
Open Source is not a panacea to everything. While I do regret than Solaris
is no longer open source, in practise it doesn't matter that much. Is your
Your mileage does definitely vary.
Post by Robert Milkowski
iPhone open sourced? No, yet still it is a great product.
Yet others use more open alternatives (app side-loading),
including completely open derivates (Cyanogenmod & Co).
There are reasons why the more open alternative is slowly
eathing the completely closed one alive.
Post by Robert Milkowski
Sun did open source most of the Solaris and it didn't really help it either.
Too little, too late, wrong license, arguably. The license impedance mismatch
is the reason ZoL is not going places, not NIH.
Post by Robert Milkowski
Post by Darren Reed
At this point I'm starting to wonder if the best thing that the entire
open source community can do is completely ignore Solaris and wait
until its parents realise their mistake. A rather sad state of affairs,
really.
I think you are unnecessarily too emotional about the whole thing.
No, it's an entirely rational business decision. Open source has lower TCO
in the long run, and empowers the organizations that care to develop in-house
knowledge. Oracle is probably the company most hated by its customers,
with the possible exception of SAP.
Post by Robert Milkowski
Post by Darren Reed
I suppose the greater point of my comment is that we should no longer
be looking for direction from Solaris or being concerned with which
features it does or doesn't have. Illumos (and by extension open source
platforms using illumos technology such as ZFS & dtrace) needs to make
its own.
You personally might not be interested, like many people are not interested on
features lets say in BSD or some other operating system. The point is that there
are many ZFS users using different platforms and many of them are interested at
what options are available. And while Illumos or BSD or even ZoL are better
solutions for some use cases, there are other use cases where Solaris 11 is
better and is worth paying money for.
For some pathological cases, yes. Those who made that business decision might
or might not regret it long-term.

In any case, Oracle made a number of business decisions.
This has made a lot of people very angry and been widely regarded as a bad move.
Robert Milkowski
2013-10-17 11:47:29 UTC
Permalink
Post by Robert Milkowski
Post by Robert Milkowski
Well, what if the database is hundreds of TBs in size and when
installed on ZFS with compression it suddenly needs 6x disk space while
still providing acceptable performance? That's a very big cost
saving... (yes, there is a build-in compression in Sybase but at least
in this case it doesn't compress data nowhere near as good as zfs).
zfs compression is available e.g. in OmniOS. As soon as decent
encryption is there it's basically feature complete (meanwhile, there
are workarounds like http://www.napp-it.org/extensions/encryption.html
).
And is Sybase certified to run pm OmniOS? Does it even run...?
Then can I run Sybase under VCS on OmniOS?
Then... etc.

The biggest cost saving in this case comes from ZFS compression.
Taking unnecessary risks and running 3rd party products on non certified
configurations doesn't make sense - the potential saving here (support cost
for Solaris 11 as compared to OmniOS) is miniscule compared to the savings
from the zfs comprassion on the amount of attached storage required. Then
there will be additional engineering cost of getting and maintaining a
custom solution based on Illumos, some open source clustering, etc. Not to
mention issues with essentially invalidating support with Sybase...

One could use Illumos as NFS servers in this scenario, but then all data
access would be always uncompressed and given 6x ration that means
transferring lots of data over network, plus additional HW is required,
clustering still not solved... just the additional HW would be more
expensive than a Solaris 11 support cost.

For many businesses if ZFS brings big cost savings Solaris 11 does make
perfect sense.
For many others OmniOS or BSD or whatever makes perfect sense as well.
Eugen Leitl
2013-10-17 12:47:14 UTC
Permalink
Post by Robert Milkowski
And is Sybase certified to run pm OmniOS? Does it even run...?
Then can I run Sybase under VCS on OmniOS?
Then... etc.
I entirely agree here -- I got myself talked into Simpana Express on
assurance of ability to backup native SMB/CIFS shares, only to discover that
it's all agent based, and agent installation doesn't seem to support
OI/OmniOS, only proprietary Solaris.
Post by Robert Milkowski
The biggest cost saving in this case comes from ZFS compression.
Taking unnecessary risks and running 3rd party products on non certified
configurations doesn't make sense - the potential saving here (support cost
for Solaris 11 as compared to OmniOS) is miniscule compared to the savings
from the zfs comprassion on the amount of attached storage required. Then
there will be additional engineering cost of getting and maintaining a
custom solution based on Illumos, some open source clustering, etc. Not to
mention issues with essentially invalidating support with Sybase...
One could use Illumos as NFS servers in this scenario, but then all data
access would be always uncompressed and given 6x ration that means
transferring lots of data over network, plus additional HW is required,
10 GBit/s copper Ethernet is really not that expensive these days, at
least in your network backbone.
Post by Robert Milkowski
clustering still not solved... just the additional HW would be more
expensive than a Solaris 11 support cost.
For many businesses if ZFS brings big cost savings Solaris 11 does make
perfect sense.
For many others OmniOS or BSD or whatever makes perfect sense as well.
Robert Milkowski
2013-10-17 12:55:02 UTC
Permalink
Post by Eugen Leitl
10 GBit/s copper Ethernet is really not that expensive these days, at
least in your network backbone.
Sure, and we do use it here as well.
It doesn't change the fact that transferring uncompressed data over NFS is
much slower than accessing it locally over FC links as compressed.

Anyway, details aside, as we are not discussing any specific case.
The point is that ZFS is being used by many different users on many
different platforms for various reasons, and some people at least are
interested in what's going on in Solaris 11/ZFS.
Darren Reed
2013-10-18 10:15:45 UTC
Permalink
Post by Robert Milkowski
...
Anyway, details aside, as we are not discussing any specific case.
The point is that ZFS is being used by many different users on many
different platforms for various reasons, and some people at least are
interested in what's going on in Solaris 11/ZFS.
If you're interested in ZFS on Solaris then I'd recommend joining the
appropriate forum over on java.net?

Darren
John D Groenveld
2013-10-18 15:33:09 UTC
Permalink
Post by Darren Reed
If you're interested in ZFS on Solaris then I'd recommend joining the
appropriate forum over on java.net?
zfs-discuss-***@solaris-zfs.java.net

John
***@acm.org
Gary
2013-10-18 15:54:32 UTC
Permalink
Post by Darren Reed
If you're interested in ZFS on Solaris then I'd recommend joining the
appropriate forum over on java.net?
Is that really in the spirit of open source advocacy?



-------------------------------------------
illumos-zfs
Archives: https://www.listbox.com/member/archive/182191/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182191/23047029-187a0c8d
Modify Your Subscription: https://www.listbox.com/member/?member_id=23047029&id_secret=23047029-2e85923f
Powered by Listbox: http://www.listbox.com
Tim Cook
2013-10-18 16:16:27 UTC
Permalink
Post by Darren Reed
If you're interested in ZFS on Solaris then I'd recommend joining the
Post by Darren Reed
appropriate forum over on java.net?
Is that really in the spirit of open source advocacy?
I'm not sure the spirit of open source advocacy has anything to do with
pointing someone at the appropriate forum for the product they're using.
Do you point people who have bugs with darwin at Apple's support forums,
or at the darwin mailing list? It's extremely likely given the length of
time the codebases have had to mature in a vacuum that bugs with Oracle's
version of ZFS are completely isolated from the open-zfs code stack.

--Tim



-------------------------------------------
illumos-zfs
Archives: https://www.listbox.com/member/archive/182191/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182191/23047029-187a0c8d
Modify Your Subscription: https://www.listbox.com/member/?member_id=23047029&id_secret=23047029-2e85923f
Powered by Listbox: http://www.listbox.com
Robert Milkowski
2013-10-18 16:34:20 UTC
Permalink
Sent: 18 October 2013 17:16
Subject: Re: [zfs] BSD ZFS vs. illumos ZFS
Post by Gary
Post by Darren Reed
If you're interested in ZFS on Solaris then I'd recommend joining the
appropriate forum over on java.net?
Post by Gary
Is that really in the spirit of open source advocacy?
I'm not sure the spirit of open source advocacy has anything to do with
pointing someone at the appropriate forum for >the product they're using.
 Do you point people who have bugs with darwin at Apple's support forums, or
at the darwin >mailing list?  It's extremely likely given the length of time
the codebases have had to mature in a vacuum that bugs >with Oracle's
version of ZFS are completely isolated from the open-zfs code stack.

I didn't intend to respond to this one (the one about java.net) as this was
a really silly comment.
Still... here are many people interested in ZFS in general and I'm sure that
many are interested in all available options - that's why BSD, Linux and
others are often mentioned here. Yes, I know that all the others are more or
less based on Illumos, while Solaris 11 isn't - but then I'm sure that well
over 50% of ZFS code in Illumos is still based on what's in Solaris... :P

Anyway, I have enough of this silly argument here which is on a verge of
trolling and spreading FUD.
If someone has such strong bad feeling about Oracle or Solaris 11 I suggest
to set-up filter and move all messages which mentions either of them to
/dev/null instead of wasting so much energy on expressing their own
frustrations.
Tim Cook
2013-10-18 17:34:02 UTC
Permalink
On Fri, Oct 18, 2013 at 11:34 AM, Robert Milkowski
Post by Darren Reed
Sent: 18 October 2013 17:16
Subject: Re: [zfs] BSD ZFS vs. illumos ZFS
Post by Gary
Post by Darren Reed
If you're interested in ZFS on Solaris then I'd recommend joining the
appropriate forum over on java.net?
Post by Gary
Is that really in the spirit of open source advocacy?
I'm not sure the spirit of open source advocacy has anything to do with
pointing someone at the appropriate forum for >the product they're using.
Do you point people who have bugs with darwin at Apple's support forums,
or
at the darwin >mailing list? It's extremely likely given the length of
time
the codebases have had to mature in a vacuum that bugs >with Oracle's
version of ZFS are completely isolated from the open-zfs code stack.
I didn't intend to respond to this one (the one about java.net) as this was
a really silly comment.
Still... here are many people interested in ZFS in general and I'm sure that
many are interested in all available options - that's why BSD, Linux and
others are often mentioned here. Yes, I know that all the others are more or
less based on Illumos, while Solaris 11 isn't - but then I'm sure that well
over 50% of ZFS code in Illumos is still based on what's in Solaris... :P
Anyway, I have enough of this silly argument here which is on a verge of
trolling and spreading FUD.
If someone has such strong bad feeling about Oracle or Solaris 11 I suggest
to set-up filter and move all messages which mentions either of them to
/dev/null instead of wasting so much energy on expressing their own
frustrations.
I couldn't care less if you want to talk about Oracle's implementation of
ZFS On this list. I don't think it's in the least bit FUD to suggest that
a better venue for that is Oracle's mailing list that they've created just
for that purpose. While an issue you have with that version of ZFS may
share a bug with the open code base, it's just as likely something nobody
here is going to be able to help you with because the code is closed.
Furthermore, even if they can fix it, what help is that going to be? It's
not like you can compile the code and and start running it. Please point
to anything I've stated in this thread that is FUD or trolling. I've
stated my opinion that I think Larry Ellison is a waste of oxygen, and I've
suggested Oracle's mailing list is a better place for discussing their
version of ZFS. How you take that as FUD is beyond me, but you're welcome
to your opinion.

--Tim



-------------------------------------------
illumos-zfs
Archives: https://www.listbox.com/member/archive/182191/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182191/23047029-187a0c8d
Modify Your Subscription: https://www.listbox.com/member/?member_id=23047029&id_secret=23047029-2e85923f
Powered by Listbox: http://www.listbox.com
Robert Milkowski
2013-10-19 09:17:39 UTC
Permalink
While an issue you have with that version of ZFS may share a bug with the
open code base

When in this thread I wrote about any bugs I'm hitting with Oracle's ZFS?
I merely pointed that there is TRIM support in Solaris 11 ZFS as well, if
anyone is interested.
Richard Elling
2013-10-19 16:04:45 UTC
Permalink
Post by Tim Cook
While an issue you have with that version of ZFS may share a bug with the
open code base
When in this thread I wrote about any bugs I'm hitting with Oracle's ZFS?
I merely pointed that there is TRIM support in Solaris 11 ZFS as well, if
anyone is interested.
Of course we are interested, thanks for the update.

To everyone else: put away the knives. Robert is a long-time friend of ZFS and
has done much to promote its use over the years. While you're here, you can thank
him for the "sync" property. There is no need to degrade these conversations with
personal attacks.
-- richard

--

***@RichardElling.com
+1-760-896-4422












-------------------------------------------
illumos-zfs
Archives: https://www.listbox.com/member/archive/182191/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182191/23047029-187a0c8d
Modify Your Subscription: https://www.listbox.com/member/?member_id=23047029&id_secret=23047029-2e85923f
Powered by Listbox: http://www.listbox.com
Gary
2013-10-18 16:39:43 UTC
Permalink
Post by Tim Cook
I'm not sure the spirit of open source advocacy has anything to do with
pointing someone at the appropriate forum for the product they're using.
"Everything ZFS running or developing on illumos-based distributions, as
well as interaction with FreeBSD and Linux (ZoL) activists. Any sensible
ZFS-related discussion and questions are welcome and taken seriously."
http://wiki.illumos.org/display/illumos/illumos+Mailing+Lists

I suppose if the subscribers to this list aren't "open" to a discussion of
"closed" source products similar origin then someone should look up irony
in the dictionary and "FUD wars" in the jargon file.

Do you point people who have bugs with darwin at Apple's support forums, or
Post by Tim Cook
at the darwin mailing list? It's extremely likely given the length of time
the codebases have had to mature in a vacuum that bugs with Oracle's
version of ZFS are completely isolated from the open-zfs code stack.
Discussing open source ZFS implementations and how they compare to its
parent code base is, in my humble opinion, a rather sensible topic. I would
wager that the percentage of code they have in common is much greater than
the percentage that they don't. I'd also wager that debating semantics is
not a sensible use of the list but since the signal to noise ratio of this
thread is rapidly declining in an unfavorable direction then I suppose we
might as well discuss anything at this point.

-Gary



-------------------------------------------
illumos-zfs
Archives: https://www.listbox.com/member/archive/182191/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182191/23047029-187a0c8d
Modify Your Subscription: https://www.listbox.com/member/?member_id=23047029&id_secret=23047029-2e85923f
Powered by Listbox: http://www.listbox.com
Tim Cook
2013-10-18 17:41:34 UTC
Permalink
Post by Gary
Post by Tim Cook
I'm not sure the spirit of open source advocacy has anything to do with
pointing someone at the appropriate forum for the product they're using.
"Everything ZFS running or developing on illumos-based distributions, as
well as interaction with FreeBSD and Linux (ZoL) activists. Any sensible
ZFS-related discussion and questions are welcome and taken seriously."
http://wiki.illumos.org/display/illumos/illumos+Mailing+Lists
I suppose if the subscribers to this list aren't "open" to a discussion of
"closed" source products similar origin then someone should look up irony
in the dictionary and "FUD wars" in the jargon file.
Perhaps you should take you own advice look up the definition of FUD wars.
Nothing anyone has suggested resembles FUD. What has been suggested is
that a better place for the discussion of the closed version of ZFS is in
the appropriate forum - Oracle's.
Post by Gary
Do you point people who have bugs with darwin at Apple's support forums,
Post by Tim Cook
or at the darwin mailing list? It's extremely likely given the length of
time the codebases have had to mature in a vacuum that bugs with Oracle's
version of ZFS are completely isolated from the open-zfs code stack.
Discussing open source ZFS implementations and how they compare to its
parent code base is, in my humble opinion, a rather sensible topic. I would
wager that the percentage of code they have in common is much greater than
the percentage that they don't. I'd also wager that debating semantics is
not a sensible use of the list but since the signal to noise ratio of this
thread is rapidly declining in an unfavorable direction then I suppose we
might as well discuss anything at this point.
-Gary
And I'd wager asking for help with a closed product in a forum where nobody
has access to the code-base is a waste of everyone's bandwidth. The
original question was around the comparison of the open-source versions of
ZFS in BSD and illumos. If OP was interested in paying Oracle for a
license I'm sure he would've included that in his list of options and
people would've responded in kind.

--Tim



-------------------------------------------
illumos-zfs
Archives: https://www.listbox.com/member/archive/182191/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182191/23047029-187a0c8d
Modify Your Subscription: https://www.listbox.com/member/?member_id=23047029&id_secret=23047029-2e85923f
Powered by Listbox: http://www.listbox.com
Gary Driggs
2013-10-18 19:22:00 UTC
Permalink
And I'd wager asking for help with a closed product in a forum where nobody has access to the code-base is a waste of everyone's bandwidth.
This is a user list -- not a dev list. Last time I checked, the
majority of users of any software product have little care about
accessing the code, its licensing model, or any other peripheral
minutia that aren't directly related to answering their support
question(s).

IIRC, the original poster asked about the differences between BSD &
Illumos/Solaris based ZFS implementations. They never asked about the
advantages or disadvantages of closed vs open source, commercial
support or lack thereof, etc. Discussion of said user's access to the
code base or support from a commercial entity either here or on any
other list is somewhat irrelevant since we've steered far off in to
the weeds already.

-Gary
Gary Driggs
2013-10-18 19:27:14 UTC
Permalink
Post by Gary Driggs
This is a user list -- not a dev list.
Sorry, I forgot which list I was referring to since I've been on more
than one ZFS list for a while. This is not exclusively a dev or user
list but the OpenZFS list states that it's only for dev & feature
discussion. That said, the original post was asking for details on
features that are related to the history of the code only in that it's
useful to know what features are supported under each OS.

-Gary
Bob Friesenhahn
2013-10-20 00:24:33 UTC
Permalink
If you're interested in ZFS on Solaris then I'd recommend joining the appropriate forum over on
java.net?
Is that really in the spirit of open source advocacy?
Crickets are chirping there.

Bob
--
Bob Friesenhahn
***@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/
John D Groenveld
2013-10-20 15:18:05 UTC
Permalink
Post by Bob Friesenhahn
Crickets are chirping there.
<URL:https://java.net/projects/solaris-zfs/lists/zfs-discuss/archive>

John
***@acm.org

Gary Driggs
2013-10-18 14:22:13 UTC
Permalink
Open source has lower TCO in the long run, and empowers the organizations that care to develop in-house knowledge.
Having worked at several different orgs in as many different
industries over the past 20 years, my experience is that the TCO
varies considerably from project to project and from org to org. I
believe there have been several studies over the years that trumpet
the same statement you've just made but in all practicality it really
comes down to how you manage your budget, the skills of the staff
involved, and the particular stack of choice regardless of open or
closed in nature. I have been an OSS proponent since the beginning of
my career so I have seen it deployed with much success and equally
with much failure but rarely if ever has its success or failure been
determined by the license of the product or the availability of the
source code or the lack thereof.

-Gary
Pasi Kärkkäinen
2013-10-17 13:52:42 UTC
Permalink
Post by Pawel Jakub Dawidek
Post by Radio młodych bandytów
http://open-zfs.org/wiki/Features
It clearly wasn't done by a FreeBSD person:)
- TRIM support (actually also in ZoL, AFAIK).
- Ability to boot from any ZFS pool (other platforms are limited to one
top-level vdev which can be either disk or a mirror (I hope that's
correct)).
- Quick listing when using options '-o name -s name' - it is at least
100 times faster than alternatives. Very handy when there is huge
number of snapshots.
- ZFS-super-owner - allows regular users to perform file system
operations as root. This is possible when the file system was mounted
by the user, the user is owner of this file system (we force nosuid
option then). Used in FreeBSD netperf cluster, so regular users can
installworld (which set proper ownership of files) to their netbooted
datasets from a build machine.
I'm sure I'm missing some.
PS. Yes, I know I should just put it onto wiki, but if anyone has some
spare cycles I'd be grateful for doing it.
I guess noone found the time yet to fix the features-table on the wiki.. :)

Can everyone get a wiki account with editing permissions? (Yeah I could check it myself, but I'm currently on a crappy mobile connection with only ssh available..)


-- Pasi
Loading...